Saturday 15:45–16:30 in Kursraum 3

On Laplacian Eigenmaps for Dimensionality Reduction

Juan Orduz

Audience level:
Experienced

Description

The aim of this talk is to describe the non-linear dimensionality reduction algorithm based on spectral techniques introduced in \cite{BN2003}. This approach has its foundation on the spectral analysis of graph Laplacian. The motivation of the construction comes from the role of the continuous limit, the Laplace-Beltrami operator, in providing an optimal embedding for manifolds.

Abstract

The aim of this talk is to describe a non-linear dimensionality reduction algorithm based on spectral techniques introduced in \cite{BN2003}.
The goal of non-linear dimensionality reduction algorithms, so called {\em manifold learning algorithms}, is to construct a representation of data on a low dimensional manifold embedded in a high dimensional space. The particular case we are going to present exploits various relations of geometric and spectral methods (discrete and continuous). Spectral methods are sometimes motivated by Marc Kac's question {\em Can One Hear the Shape of a Drum?} which makes reference to the idea of recovering geometrical properties from the eigenvalues (spectrum) of a matrix (linear operator). Concretely, the approach followed in \cite{BN2003} has its foundation on the spectral analysis of the graph Laplacian of the adjacency graph constructed from the data (\cite{vonLuxburg2007}). The motivation of the construction relies on the continuous limit analogue, the Laplace-Beltrami operator, in providing an optimal embedding for manifolds. We will also indicate the relation with the associated heat kernel operator (\cite{Ham2004}). Instead of following a pure formal approach we will present the main geometric and computational ideas of the algorithm. Hence, with basic knowledge of linear algebra (eigenvalues) and differential calculus you will be able to follow the talk. Finally we will show a concrete example in Python using scikit-learn.

Subscribe to Receive PyData Updates

Subscribe