My research is centered
on information theory. One of my interests is how to
use ideas from information theory to derive results
in probability theory. Many of the most important
reslts in probability theory are convergence
theorems, and many of these convergence theorems can
be reformulated so that they state that the entropy
of a system increases to a maximum or that a
divergence converge to a minimum. These ideas are
also relevant in the theory of statistical tests.
Recently I have formalized a method for deriving
Jeffreys prior as the optimal prior using the
minimum description length principle.
I am also interested in quantum information theory,
and I think that information theory sheds new light
on the problems of the foundation of quantum
mechanics. In a sense the distinction between matter
and information about matter disappear on the
quantum level. Combining this idea with group
representations should be a key to a better
understanding of quantum theory.
I have also worked on the relation between Bayesian
networks and irreversibility, and my ultimate goal
is to build a bridge between these ideas and
information theory. I am working on a new theory
where methods from lattice theory are used. I think
lattices of functional dependence will provide a
more transparent framework to describe causation.
Hopefully it will lead to better algorithms for
detecting causal relationship, but the most
important application might be in our description of
quantum systems, where we know that our usual notion
of causation break down.
I am associated editor of the journal IEEE Transactions on Information Theory covering probability and statistics. I am editorial board member of the
journal Entropy and the journal Stats. I was Editor-in-Chief of Entropy
2007-2011 and editor 2011-2015. This journal was pioneering in open access publishing.
I serve as reviewer of numerous other
journals as can be seen from my newly created Publons profile.
ISIT 2018 June 17-22, Vail, USA.
From Physics to Information Sciences and Geometry May 14-16 in Barcelona, Spain (or Catalonia?).
International Zürich Seminar on Information and Communication (IZS) 2018 21-23/2 I will give an invited talk entitled Horizont independent MDL.
WITMSE 2017 Paris 11-13/9 I gave an invited talk.
Entropy Power Inequalities at AIM, San José May 1st-5th. 2017.ISIT 2017 June. Took place in Aachen in Germany. I gave a presentation entitled Quantum Information on Spectral sets.
I was visiting University of
Hawai'i Jan.-Feb. 2016. I will gave a lecture series on Bregman divergences. The
first will be held Thursday 21/1 in Holmes Hall. See flyer
for detailed information.
I have made a BibTeX
file with a lot of items related to
Society I am senoir member og IEEE and the
Information Theory Society is a part of this organization. The page has a
lot of useful links related to
Federation I am active climber and has
served as president of this organization.
The Journal that I was Editor-in-Chief for.
scientific equipment A less useful link.
IEEE Transactions on Information Theory I am associated editor of this journal covering Information Theory and Statistics.
Description Length on the web This pages is
devoted to MDL and its applications. I contains links to
articles and people working in the field.
portfolio Here I have collected various
material relevant for my teaching activities.
cross entropy method
Here are links to
some of my favorite software.
convenient for storing and sharing documents.
Software to create mathematical figures. It can output
an image as pgf code.
Program that helps you manage your BibTeX database.
Online LaTeX diff tool You can send two files with LaTeX code to this cite and you will get one PDF file back with colormarking of all changes.
LyX User friendly
interface to LaTeX.
Great for annotating PDF documents. The free version is
good and the prof. version is even better.
R Great for
statistical programming. With the module Sweave R-code
can be embedded directly into LaTeX documents.
Editor for TikZ/pgf code.
Here are links to
some persons that I use to collaborate with.
Tim van Erven