Shane Josias

I am a junior lecturer in Applied Mathematics at Stellenbosch University, South Africa. I am also a PhD candidate, where I focus on the computational aspects and out-of-distribution properties of continuous-time normalising flows.

Prior to the above, I've worked as a software engineer writing complex events processing applications, as well as adding functionality to the framework on top of which those applications run. In addition, I also worked on various aspects of database integration.

I completed an MSc in Applied Mathematics at Stellenbosch University early 2020, where I tackled properties like a long-tailed data distribution and semantic ambiguity in visual relationship recognition. My experience with visual relationship recognition has inspired an interest in robust and generalisable visual representations.

news

Dec 16, 2023	Presented our work at the Symbiosis of Deep Learning and Differential Equations workshop at NeurIPS.
Dec 8, 2022	Awarded a poster prize at the 65th Annual SAMS Congress.
Oct 24, 2022	Research assistant position available [closed].
Oct 23, 2022	Invited to attend the Nobel Symposium on Predictability in Science in the Age of AI.
Oct 6, 2022	Hosted the Standard Bank Lab Hackathon.

selected publications

Jacobian norm regularisation and conditioning in neural ODEs

Shane Josias, and Willie Brink

Communications in Computer and Information Science, 2022

Abs HTML PDF Poster

A recent line of work regularises the dynamics of neural ordinary differential equations (neural ODEs), in order to reduce the number of function evaluations needed by a numerical ODE solver during training. For instance, in the context of continuous normalising flows, the Frobenius norm of Jacobian matrices are regularised under the hypothesis that complex dynamics relate to an ill-conditioned ODE and require more function evaluations from the solver. Regularising the Jacobian norm also relates to sensitivity analysis in the broader neural network literature, where it is believed that regularised models should be more robust to random and adversarial perturbations in their input. We investigate the conditioning of neural ODEs under different Jacobian regularisation strategies, in a binary classification setting. Regularising the Jacobian norm indeed reduces the number of function evaluations required, but at a cost to generalisation. Moreover, naively regularising the Jacobian norm can make the ODE system more ill-conditioned, contrary to what is believed in the literature. As an alternative, we regularise the condition number of the Jacobian and observe a lower number of function evaluations without a significant decrease in generalisation performance. We also find that Jacobian regularisation does not guarantee adversarial robustness, but it can lead to larger margin classifiers.
Class-Selective Mini-Batching and Multitask Learning for Visual Relationship Recognition

Shane Josias, and Willie Brink

SAIEE Africa Research Journal, 2021

Abs HTML PDF

An image can be described by the objects within it, and interactions between those objects. A pair of object labels together with an interaction label is known as a visual relationship, and is represented as a triplet of the form (subject, predicate, object). Recognising visual relationships in images is a challenging task, owing to the combinatorially large number of possible relationship triplets, which leads to an extreme multiclass classification problem. In addition, the distribution of visual relationships in a dataset tends to be long-tailed, i.e. most triplets occur rarely compared to a small number of dominating triplets. Three strategies to address these issues are investigated. Firstly, instead of predicting the full triplet, models can be trained to predict each of the three elements separately. Secondly a multitask learning strategy is investigated, where shared network parameters are used to perform the three separate predictions. Thirdly, a class-selective mini-batch construction strategy is used to expose the network to more of the rare classes during training. Experiments demonstrate that class-selective mini-batch construction can improve performance on classes in the long tail of the data distribution, possibly at the expense of accuracy on the small number of dominating classes. It is also found that a multitask model neither improves nor impedes performance in any significant way, but that its smaller size may be beneficial. In an effort to better understand the behaviour of the various models, a novel evaluation approach for visual relationship recognition is introduced. We conclude that the use of semantics can be helpful in the modelling and evaluation process.