Shintaro Shiba

Project Lecturer at the University of Tokyo, Ph.D in Event-based Computer Vision

My current affiliation:

  • Project Lecturer (Jr. Associate Prof.) at the Department of Electrical Engineering and Information Systems, the University of Tokyo
  • Visiting Lecturer at Keio University
  • Visiting Faculty at Nagoya University
  • Group leader, HW/SW co-design for Edge AI

Looking for:

  • Undergrad / grad students (all levels) who want to work on any of (1) event-based computer vision/machine learning, (2) HW/SW co-design (processor design), and/or (3) robotics and physical AI. I teach students both at UTokyo and Keio.
  • Full-time postdocs/research associates (all levels) in digital or analog-digital circuit designs. We have several open positions.

We also welcome part-time / research assistant positions so please reach out to me!

I got my Ph.D. in Engineering, focusing on event-based motion estimation, with the supervision by Prof. Guillermo Gallego (TU Berlin, Germany) and Prof. Yoshimitsu Aoki (Keio University, Japan). Event cameras are the very intersection of my different backgrounds: neuroscience, machine learning, and autonomous driving. My original background is in neuroscience as Bachelor’s and Master’s degrees. I wanted to study animal brains before rushing into the AI field, since they are very efficient, robust, and still accurate in recognizing the world. My pre-doctoral professional experience is machine-learning software engineer in production-scale MLOps (ML and data pipeline) for autonomous driving at Woven by Toyota. There I learned practices to convert ML researches into products to solve the real-world problems. Please see my CV for more details.

Je parle un peu le français and spreche ich etwas Deustch. Apart from work, I love to play jazz saxophone :)

現在の所属:

  • 東京大学 工学系研究科 電気系専攻 特任講師
  • 慶應義塾大学 理工学研究科 訪問講師
  • 名古屋大学 工学系研究科 招へい教員

一緒に研究をされたい方は、ご連絡ください。特に:

  • 学部/大学院生。(1) イベントベースビジョンと機械学習, (2) HW/SWの協調設計, あるいは (3) ロボティクス分野に興味がある方。
  • ポスドク・シニアポスドクの方、特に、デジタル回路設計。
  • パートタイム(RA)等

イベントカメラ(イベントベースカメラ・イベントビジョンセンサー・ダイナミックビジョンセンサー)に関するコンピュータビジョン研究と開発をしています。 元々、神経科学を修士まで勉強し、生物のように頑健で電力効率の高い視覚認知システムの実現についての興味がありました。 同時に、自動運転用の認識ソフトウェア・機械学習開発をおこなった経験の中で、 従来のフレームベースカメラに存在するモーションブラーやダイナミックレンジ、データや消費電力効率の悪さに、産業面からの長期的な課題意識を持ちました。 そこでイベントカメラに着目し、研究に取り組み、分野のトップ研究室であるベルリン工科大に留学し、博士(工学)を取得しました。

この技術を産業と結びつけ、マーケットを創出するために、 産・学を飛び越えて挑戦をしています。

news

Jul 27, 2026 I am honered and excited to receieve the 39th The Advanced Technology Award by Sankei Newspaper Inc.!! (details)
The Advanced Technology Award is a prestigious annual recognition program hosted by The Sankei Newspaper Inc. to celebrate outstanding scientific and technological achievements by young researchers, engineers, and students in Japan. Established in 1986 with support from Nobel Prize laureate Kenichi Fukui, the award aims to foster innovation and help fulfill Japan’s national goal of becoming a “Nation Built on Science and Technology”. Originally dedicated to university and technical college students, it was expanded in 2002 to include young researchers from corporations and institutes.
第39回 産経新聞 先端技術大賞 産経新聞社賞を受賞させていただく運びとなりました (HP, News)。授賞式は、7/22、明治記念館にて、高円宮妃久子様ご臨席の元、執り行われました。
「先端技術学生論文表彰制度」は1986年に理工系学生の独創性と創造性をはぐくみ、研究への意欲を高めることを目的に創設されました。 第16回より「科学技術創造立国」の実現には、産学官の連携や若手技術者の育成が不可欠との考えから、企業の若手研究者・技術者も表彰対象に加えて、名称も「独創性を拓く 先端技術大賞」と改めました。
Jun 12, 2026 We received the audience award (top voting) at the Japanese largest conference, SSII 2026. SSII 2026にて、ガウシアン再構成の論文がオーディエンス賞を獲得しました。 News, Paper.
Jun 01, 2026 See you at CVPR 2026! I will (1) give a short oral at the URVIS Workshop on June 4th (Thu) AM (Talk title: Leveraging Temporal Information from Events for 3D Reconstruction), and (2) present our Highlight poster “Geometric-Photometric Event-based 3D Gaussian Ray Tracing” on June 6th (Sat) PM, Session 4. Project, Paper, Code, Video.
Apr 01, 2026 I started a new position at the University of Tokyo! Faculty page. If you want to work with me, please contact me. 東京大学 工学系研究科 電気系専攻に、特任講師として着任しました。
Mar 07, 2026 Our new paper is accepted to CVPR 2026! “Geometric-Photometric Event-based 3D Gaussian Ray Tracing”, Project, Paper, Code. Next week, I will be presenting some posters at the German Robotics Conference – see you in Cologne.
Oct 11, 2025 See you at ICCV! Our paper “Simultaneous Motion And Noise Estimation with Event Cameras” (paper, code) is accepted at the ICCV main conference. I will be presenting the poster at the FOUND Workshop (Oct 19), the NeVi Workshop, and the main conference (Oct 21).
May 01, 2025 In May and June, I will give several talks and presentations. In May, I will give an invited talk at SSII 2025 in Japan. In June, I will give an invited talk at CVPR Workshop on Event-based Vision. Also, one paper (GA3CE) is accepted at the CVPR main conference, three papers (E-VLC, AR demo, and Variational CMax) are accepted at CVPR Workshop on Event Vision, and two papers (1, 2 - link coming soon) are accepted at IEEE IV. I am looking forward to meeting up friends at CVPR!
Mar 31, 2025 Mr. Ryo Yamaki, a Master student, and Mr. Yutaro Aze, a Bachelor student, successfully finished his Master/Bachelor theses (Keio Uni, Faculty of Science and Technology)! Ryo will present his work, Iterative Event-based Motion Segmentation by Variational Contrast Maximization, at CVPR Workshop on Event Vision in June.
Sep 28, 2024 Looking forward to attending ECCV 2024, Milan! I have two poster presentations at Workshop on Neuromorphic Vision Workshop on Sunday.
Aug 01, 2024 On 5th August I will give an invited talk and poster presentation at 27th Meeting on Image Recognition and Understanding (MIRU2024), Japan, about the PAMI paper “Event-based Background-Oriented Schlieren”.
Jun 01, 2024 On 14th June, I will give an invited talk and poster presentation at Symposium on Sensing via Image Information (SSII) 2024, Japan.
May 04, 2024 Our new paper is accepted to IEEE T-PAMI! “Secrets of Event-based Optical Flow, Depth and Ego-motion Estimation by Contrast Maximization”, Paper. I will update the reposiroty.
Apr 15, 2024 Our new paper “3D Human Scan With A Moving Event Camera” is accepted to IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop On Computer Vision For Mixed Reality (CV4MR), Seattle, 2024! Paper.
Mar 25, 2024 I am honered to receieve the three awards related to my Ph.D. research, such as: Dean’s Award at Keio, The Telecommunication Advancement Foundation, and Japanese Society of Automotive Engineering. In total, I received four awards including the Ikushi prize. I deeply appreciate my collaborators, friends, and family.
Feb 25, 2024 On March 5th, I will give an invited talk at Next Generation Image Acquisition and Vision System (次世代画像入力ビジョンシステム部会), which is a part of JTTAS (日本工業技術振興協会).
Feb 03, 2024 Mr. Kai Kohyama, a Bachelor student that I have been supervising, successfully finished his Bachelor thesis (Keio Uni, Faculty of Science and Technology)! The title and details are to be updated, as we prepare a submission.
Jan 20, 2024 I am honered and excited to receieve the 14th JSPS Ikushi Award!! (details) JSPS (Japan Society for the Promotion of Science) established the JSPS Ikushi Prize program in 2010. It functions to formally recognize outstanding doctoral students who can be expected to contribute to Japan’s future scientific advancement. About 16 recipients are chosen for the prize each fiscal year, receiving a certificate, a medal, and a purse of 1.1 million yen.
Dec 01, 2023 The paper “Event-based Background-Oriented Schlieren” is now featured at the top page of the TUBerlin webpage. Yay! News
Oct 24, 2023 Our new paper is accepted to IEEE T-PAMI! “Event-based Background-Oriented Schlieren”, Paper and Code.
Aug 30, 2023 Mr. Yannick Klose, a Master student that I have been supervising, successfully finished his Master thesis (TUBerlin Faculty IV)! The title is to be updated (A part of his work is under review).
Jul 11, 2023 I will give an invited talk at ACRO, Teikyo University, on July 12th. Details to be updated.
Jun 14, 2023 See you all at CVPR 2023, Vancouver! I have a poster presentation at Event Vision Workshop (19th Mon AM/PM). Looking forward to seeing people in the event-based vision community!
Jun 07, 2023 I will give an invited talk at Image Processing Group, Universitat Politècnica de Catalunya, on June 12th.
May 18, 2023 I finished the defense successfully! I appreciate the thesis committee, including Prof. Aoki at Keio, Prof. Gallego at TUBerlin, Prof. Daniilidis at UPenn, and all audience for the constructive and useful discussions.
May 02, 2023 I will do my defense on May 17. It’s online, so please contact me if you are interested in joining. Also, I will give an invited talk at SCIoI, TU Berlin, on May 25th.

latest posts

May 08, 2022 Life in Berlin
Dec 31, 2020 2020年
Jun 24, 2020 英語の勉強方法について