About

Jr-Jen Chen (Jacky)

Deep Learning Researcher

Hi, I'm Jr-Jen Chen, a master's student in the Vision and Learning Lab (VLLab) at National Taiwan University's Graduate Institute of Communication Engineering. I'm advised by Prof. Yu-Chiang Frank Wang and currently collaborating
with Yen-Chun Chen from Microsoft on multi-modal large language models and video understanding. Besides, I'm also interested in the application of MLLMs in robotics. I'm actively seeking visiting student positions in deep learning and computer vision to further explore these areas.

Research Interests:

Deep Learning Multi-modal Large Language Models Reasoning-across-time for Video Understanding Video Reasoning and Moment Localization Continual Learning MLLMs in Robotics

Publications

Publication Image 1

ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videos

Authors: Jr-Jen Chen, Yu-Chien Liao, Hsi-Che Lin, Yu-Chu Yu, Yen-Chun Chen, Yu-Chiang Frank Wang

Under review: NeurIPS 2024 Datasets and Benchmarks Track.

[ Project Page ] [ arXiv ] [ Github ] [ Huggingface ] [ Leaderboard ]



Publication Image 1

Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models

Authors: Yu-Chu Yu, Chi-Pin Huang, Jr-Jen Chen, Kai-Po Chang, Yung-Hsuan Lai, Fu-En Yang, Yu-Chiang Frank Wang

Conference: European Conference on Computer Vision (ECCV), September 2024.

[ arXiv ]

Resume

Education

National Taiwan University

2023 - Present

Master of Graduate Institute of Communication Engineering

  • GPA: 4.30 / 4.30

National Taiwan University

2019 - 2023

Bachelor of Mechanical Engineering

  • GPA: 4.08 / 4.30
  • Rank: 8 / 140
  • Award: 3 times of Dean's List

Teaching Assistant

Deep Learning for Computer Vision

2022 Fall, 2023 Fall

Instructor: Yu-Chiang Frank Wang

Awards

Certificate of Achievement of MOBILEHEROS 2021 CONNECTIVITY INNOVATION AWARDS

awarded by Bureau of Industry, Ministry of Economic Affairs

2nd of NASA 2020, INTERNATIONAL SPACE APP CHALLENGE

awarded by American Institute in Taiwan

Professional Experience

Graduate Student Researcher

2022 - Present

Vision and Learning Lab, Advisor: Yu-Chiang Frank Wang

Graduate Institute of Communication Engineering, National Taiwan University

  • Multi-modal Large Langugage Models / Video Understanding
  • Continual Learning on Vision-Language Models
  • Diffusion Models Personalization

Undergraduate Student Researcher

2022.01 - 2022.08

Robot Learning Lab, Advisor: Shao-Hua Sun

Department of Electrical Engineering, National Taiwan University

  • Reinforcement Learning
  • Robot Manipulation

ADLINK Assistant Engineer

2022.07 - 2022.08

IoT Solutions & Technology Business Unit-Solution Architect & Technical Support

  • Machine Learning / Anomaly Detection
  • Edge Computation

Undergraduate Student Researcher

2021.08 - 2022.01

Bio-inspired Robotics Lab, Advisor: Pei-Chun Lin

Department of Mechanical Engineering, National Taiwan University

  • Publication: EnveRob: Integration of an Intelligent Robotic Arm System for Mail Delivery Applications
  • Object Dection / Depth Estimatioin
  • Robot Operation System (ROS).

Projects

Publication Image 1

Adapt VLMs on Imitation Learning of Robotic Manipulation

Course: Reinforcement learning

Rank: 3 (out of all teams)

[ Slide ]



Publication Image 1

Pupil Tracking (Instance Segmentation)

Course: Computer vision

Rank: 1 (out of all teams)

[ Slide ]



Publication Image 1

EnveRob: Integration of an Intelligent Robotic Arm System for Mail Delivery Applications

Publish in: 2023 International Conference on Advanced Robotics and Intelligent Systems (ARIS)

Authors: Shih-Huai Kao, Wei-Lin Pai, Feng-En Yeh, Jr-Jen Chen, Yu-Wei Lin, Pei-Chun Lin

[ IEEE ]



Publication Image 1

Skull Fracture Detection

Course: Deep learning for computer vision

Rank: 3 (out of all teams)

[ Poster ]