Singular Learning Theory and Information Criteria

  • Thu 18 Mar 21

    14:00 - 15:00

  • Online


  • Event speaker

    Sumio Watanabe

  • Event type

    Lectures, talks and seminars

  • Event organiser

    Mathematical Sciences, Department of

  • Contact details

    Dr Osama Mahmoud

These Departmental Seminars are for everyone in Maths. We encourage anyone interested in the subject in general, or in the particular subject of the seminar, to come along.  It's a great opportunity to meet people in the Maths Department and join in with our community.

Singular Learning Theory and Information Criteria

A statistical model is called regular if the map from a parameter to a probability density is one-to-one, and if its Fisher information matrix is positive definite. Otherwise, it is called singular. If a statistical model has hierarchical  structures or latent variables, it is not regular but singular. Many statistical models such as neural networks, normal mixtures and matrix factorisations are singular, resulting that the ordinary asymptotic theory does not hold.

In this presentation, we introduce singular learning theory which enables us to clarify the generalisation performance of singular statistical models. Also we show that information teria WAIC and WBIC are constructed. 


Sumio Watanabe, Tokyo Institute of Technology

How to attend

If not a member of the Dept. Mathematical Science at the University of Essex, you can register your interest in attending the seminar and request the Zoom’s meeting password by emailing Dr Osama Mahmoud (o.mahmoud@essex.ac.uk).

Related events