Piotr Bilinski, Ph.D., Research Fellow at University of Oxford

Piotr Biliński, Ph.D.

Research Fellow at University of Oxford

I am an Assistant Professor at University of Warsaw and Senior Applied Scientist at Amazon.

Research Interests:

Deep Learning,
Computer Vision,
Generative Models,
Image and Video Generation,
Speech Synthesis,
Natural Language Generation,
Machine Learning.

News:

Program Committee Member at IJCAI 2024.
Program Committee Member at ECAI 2024.
Accepted ECAI 2023 paper.
Accepted Interspeech 2023 paper.
Accepted ICASSP 2023 paper.
Presentation at GHOST Day: Applied Machine Learning Conference, 2023.
...
Area Chair of the ACM Multimedia (ACM MM), 2021.
Accepted AAAI 2021 paper.
Accepted CVPR 2020 paper.
Accepted CVPR 2020 LUV workshop paper.
Chair at ECAI 2020.
Accepted WACV 2020 paper.
Area Chair of the ACM Multimedia (ACM MM), 2020.
Accepted AAAI 2019 paper.

I am a Research Fellow at University of Oxford in England since September 2016.

I work on Semantic 3D Dense SLAM, which links:

semantic labelling that uses deep learning, and
dense geometry reconstruction using depth fusion.

From January 2015 till September 2016, I was a Post-Doctoral Researcher at INRIA in France, Sophia-Antipolis Research Center, STARS team.

I was working on automatic video understanding and behavior detection in videos, in particular on:

Detection of human actions in videos (recognition and localization),

Assessment of people cognitive and behavioral status from activities of daily living (detecting people with dementia and estimating their health status; home care environments),

Crowd behavior detection in surveillance videos, violence and fight recognition and localization.

From April till August 2015, I was a Visiting Resercher at the Honeywell Laboratory, Research Institute, where I was working on video understanding in surveillance videos for security applications; in particular, on automatic recognition and localization of crowd violence in surveillance videos.

In December 2014, I obtained my Ph.D. degree in Computer Science (Computer Vision) from the INRIA Research Institute and from the University of Nice Sophia-Antipolis in France (Topic: Human Action Recognition in Videos |
Jury: Ramakant Nevatia, Frederic Jurie, Ivan Laptev, Frederic Precioso, Francois Bremond | 2010 - 2014 | more information). During my Ph.D. studies, I was conducting research at the INRIA under the supervision of François Brémond, Reseach Director.

During my Ph.D.:

I was a Research Intern at the Microsoft Research in Redmond, United States, where I was working in audio and signal processing domain, on HRTF Personalization using Anthropometric Features. I created algorithms for automatic extraction of anthropometric features from 3D head scans, and I proposed several techniques for HRTF recommendation and HRTF synthesis. More information on the official website of the Microsoft Research.
U.S. Patent.

I was working on trajectory management and analysis as a Student Developer at the Google Inc. / OpenCV as part of Google Summer of Code.

Prior to that, I obtained my M.Sc. degree in Computer Science (2008 - 2009) and B.Sc. degree in Computer Science (2004 - 2008) from the Poznan University of Technology in Poland. During this time, I recevied award scholarship at every semester, and Minister of Science and Higher Education Award for outstanding academic achievements. I was also participating in various algorithmic and IT competitions, and I had some considerable achievements. Among various scientific and industrial experiences, I was a research intern in the PULSAR team at INRIA, where I was conducting research on visual tracking - on feature point and multiple object tracking in videos that is working with occlusions and is based on appearance descriptors.

piotrb [_ at _] robots.ox.ac.uk

bilinski [_ at _] mimuw.edu.pl

If you have any questions or queries, or you would like to know more about me, please feel free to drop me a line.

Abstract in English
Abstract in French
Manuscript in English

Ph.D.

On December 5, 2014, I obtained my Ph.D. degree in Computer Science from the INRIA and from the University of Nice Sophia-Antipolis in France. The topic of my Ph.D. was "Human Action Recognition in Videos" (in French: "Reconnaissance d’action humaine dans des vidéos"). All my research was conducted at the INRIA Sophia-Antipolis Research Institute under the supervision of François Brémond, Reseach Director.

The jury of my Ph.D. defense was:

Ramakant Nevatia, Professor, University of Southern California, reviewer,
Frederic Jurie, Professor, University of Caen, reviewer,
Frederic Precioso, Professor, Polytech Nice Sophia, president,
Ivan Laptev, Research Director, INRIA Paris, examinator,
Francois Bremond, Research Director, INRIA Sophia-Antipolis, advisor.

During my Ph.D., I was also:

Research Intern at the Microsoft Research, Redmond, USA,
Student Developer at the Google Inc. / OpenCV as part of Google Summer of Code.

but this work is not included in my manuscript. Information about this work can be found here.

Activities & Memberships

Recent Professional Activities & Memberships
Program Committee of the 33rd International Joint Conference on Artificial Intelligence (IJCAI 2024), Jeju, South Korea, 2024.
Program Committee of the 27th European Conference on Artificial Intelligence (ECAI), Santiago de Compostela, Spain, 2024.
Program Committee of the 26th European Conference on Artificial Intelligence (ECAI), Cracow, Poland, 2023.
Member of the Technical Program Committee of the International Conference ACM Multimedia (ACM MM), Ottawa, Canada, 2023.
...
Area Chair of the ACM Multimedia (ACM MM), Seattle, United States, 2020.
Chair for Vision (Deep Learning for Vision) at the 24th European Conference on Artificial Intelligence (ECAI), 2020.
Program Committee of the International Conference on Learning Representations (ICLR), 2021.
Program Committee of the Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI), Vancouver, Canada, 2021.
Program Committee of the AAAI 2021 Special Track on AI for Social Impact, Vancouver, Canada, 2021.
Program Committee of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), New York, USA, 2020.
Program Committee of the AAAI 2020 Emerging Track on AI for Social Impact, New York, USA, 2020.
Program Committee of the 24th European Conference on Artificial Intelligence (ECAI), 2020.
Member of the Technical Program Committee of the Medical Image Computing and Computer Assisted Interventions (MICCAI), Lima, Peru, 2020.
Journal Reviewer of Transactions on Interactive Intelligent Systems
Area Chair of the ACM Multimedia (ACM MM), Nice, France, 2019.
Member of the Technical Program Committee of the Medical Image Computing and Computer Assisted Interventions (MICCAI), Shenzhen, China, 2019.
Member of the Program Committee of the IEEE International Conference on Automatic Face and Gesture Recognition (IEEE FG), Lille, France, 2019.
Member of the Technical Program Committee of the IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS), Taipei, Taiwan, 2019.
Member of the Program Committee of the IEEE International Sypomsium on Multimedia (IEEE ISM), San Diego, CA, USA, 2019.
Member of the Program Committee of the International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany, 2019.
Member of the Technical Program Committee of the International Conference ACM Multimedia (ACM MM), Seoul, Korea, 2018.
Member of the Program Committee of the IEEE International Sypomsium on Multimedia (IEEE ISM), Taichung, Taiwan, 2018.
Member of the Program Committee of the IEEE International Conference on Automatic Face and Gesture Recognition (IEEE FG), Xi'an, China, 2018.
Member of the Program Committee of the International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany, 2018.
Member of the Technical Program Committee of the International Conference on Sensor Networks and Signal Processing (SNSP), Xi'an, China, 2018.
Member of the Technical Program Committee of the IEEE International Conference on Automatic Face and Gesture Recognition (IEEE FG), Washington, D.C., USA, 2017.
Member of the Technical Program Committee of the IEEE International Conference on Advanced Video and Signal based Surveillance (IEEE AVSS), Lecce, Italy, 2017.
Member of the Program Committee of the International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany, 2017.
Member of the Program Committee of the IEEE International Symposium on Multimedia (IEEE ISM), Taichung, Taiwan, 2017.
Member of the Technical Program Committee of the International Conference ACM Multimedia (ACM MM), Amsterdam, Netherlands, 2016.
Member of the Program Committee of the International Workshop on Crowd Understanding, organized in conjunction with the ECCV 2016, Amsterdam, Netherlands, 2016.
Member of the Program Committee of the IEEE International Symposium on Multimedia (IEEE ISM), San Jose, California, USA, 2016.
Computer Vision and Image Understanding (CVIU) Journal Reviewer.
IEEE Transactions on Circuits and Systems for Video Technology Reviewer.
IEEE Signal Processing Letters Reviewer.
IEEE Transactions on Biomedical Engineering Reviewer.
Pattern Recognition Letters Reviewer.
Signal Processing Reviewer.
Multimedia Tools and Applications Reviewer.
Journal of Imaging Reviewer.
KSII Transactions on Internet and Information Systems Reviewer.
ICCV 2013 Reviewer.
IEEE Student Member.
ACM Student Member.

Invited Talks in 2015 & 2016

Invited Talks and Presentations in 2015 & 2016.
Date	Event & Place
10.2017	Invited talk at 4-th TASK-CV: Transferring and Adapting Source Knowledge in Computer Vision Challenge, ICCV 2017 in Venice.
10.2017	Invited talk at Joint COCO and Places Recognition Challenge, ICCV 2017 in Venice.
08.2017	Presentation of our paper at the 25th European Signal Processing Conference (EUSIPCO) in Kos island.
09.2016	Oral presentation of our paper at the 15th International Conference of the Biometrics Special Interest Group in Darmstadt.
07.2016	Invited talk at the University of Southern California in Los Angeles.
07.2016	Oral presentation at the 13th IEEE International Conference on Advanced Video and Signal based Surveillance (IEEE AVSS) in Colorado Springs.
12.2015	Invited talk at the CENTAUR 2nd Annual Webinar.
07.2015	Oral and poster presentations at the 24th International Joint Conference on Artificial Intelligence (IJCAI) in Buenos Aires.
06.2015	Invited talk at the Center for Machine Perception (CMP), Department of Cybernetics, Czech Technical University (CTU) in Prague.
05.2015	Invited talk at the Institute of Information Theory and Automation (UTIA, Ústav teorie informace a automatizace) in Prague.
05.2015	Invited talk at the Honeywell, for Honeywell Prague, Honeywell Brno and Honeywell USA.
01.2015	Invited talk at the Agency for Science, Technology and Research (A*STAR)'s Institute for Infocomm Research (I2R) in Singapore.
01.2015	Invited talk at the Nanyang Technological University (NTU) in Singapore.

Selected Publications

G3AN: Disentangling motion and appearance for video generation
Yaohui Wang, Piotr Bilinski, Francois Bremond, Antitza Dantcheva
IEEE Computer Vision and Pattern Recognition (CVPR)
Seattle, Washington, USA, June 2020

ImaGINator: Conditional Spatio-Temporal GAN for Video Generation
Yaohui Wang, Piotr Bilinski, Francois Bremond, Antitza Dantcheva
Winter Conference on Applications of Computer Vision (WACV)
Snowmass village, Colorado, USA, March 2020

Multi³Net: Segmenting Flooded Buildings via Fusion of Multiresolution, Multisensor, and Multitemporal Satellite Imagery
T. G. J. Rudner , M. Rußwurm , J. Fil , R. Pelich , B. Bischke , V. Kopackova, and P. Bilinski
AAAI Conference on Artificial Intelligence (AAAI)
Honolulu, United States, January-February 2019

Dense Decoder Shortcut Connections for Single-Pass Semantic Segmentation
P. Bilinski and V. Prisacariu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
Salt Lake City, United States, June 2018

U.S. Patent: HRTF Personalization based on Anthropometric Features
P. Bilinski, J. Ahrens, M. Thomas, I. Tashev, J. Platt, D. Johnston
United States Patent, US20150312694A1. 2018-02-20.

Video Covariance Matrix Logarithm for Human Action Recognition in Videos
Piotr Bilinski and Francois Bremond
International Joint Conference on Artificial Intelligence (IJCAI)
Buenos Aires, Argentina, July 2015

HRTF Magnitude Synthesis via Sparse Representation of Anthropometric Features
P. Bilinski, J. Ahrens, M. R. P. Thomas, I. J. Tashev, J. C. Platt
International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Florence, Italy, May 2014

Full list of publications

Videos & Demos

HRTF Personalization using Anthropometric Features.

My presentation at the Microsoft Research in Redmond, United States given on September 27, 2013.

Abstract: Head-related transfer functions (HRTFs) represent the acoustical transfer function between a sound source and the entrance of the blocked ear canal. Imposing HRTFs onto a non-spatial audio signal and playing back the result over headphones evokes the perception of a virtual 3D auditory space. The commercial breakthrough of HRTF-based audio has been hindered by the fact that HRTFs are highly individual and using HRTFs other than the user’s own can significantly impair the result. Since the measurement of HRTFs is an expensive process, automatic selection or synthesis of HRTFs is desirable. We therefore propose methods for HRTF selection and synthesis based on Decision Trees, Sparse Representation and Neural Networks. These methods are based on the mapping of people’s anthropometric features and other personal information to the acoustic HRTFs. The results are analyzed both objectively using measures such as spectral distortion as well as in a listening experiment.

Video with captions, slides, transcript and more are available on the official website of the Microsoft Research.

Source Code

The links below are intended for people I am collaborating with.
Source Code
Covariance for IDT (C++).
Distance covariance for IDT (C++).
Improved Fisher Vectors with spatial information encoding (C++ & Matlab).
SVM with linear and χ² kernels for a single machine and a PC cluster (C++).
MKL with linear and χ² kernels for a single machine and a PC cluster (C++).
Algorithms Library (C++), including: Dijkstra, Bellman Ford, Max-Flow (Ford-Fulkerson, Dinic), Min-Cost Max-Flow (Edmonds and Karp), Minimum Spanning Tree (Prim, Kruskal), Knuth-Morris-Pratt, Manacher's algorithm, QuickSort, MergeSort, HeapSort, Interval Tree, BST Tree, Convex Hull, etc.