About
Jr-Jen Chen (Jacky)
Deep Learning Researcher
Hi, I'm Jr-Jen Chen, a master's student in the Vision and Learning Lab (VLLab) at National Taiwan University's Graduate Institute of Communication Engineering. I'm advised by Prof. Yu-Chiang Frank Wang and currently collaborating
with Yen-Chun Chen from Microsoft on multi-modal large language models and video understanding. Besides, I'm also interested in the application of MLLMs in robotics.
I'm actively seeking visiting student positions in deep learning and computer vision to further explore these areas.
Research Interests:
Publications
ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videos
Authors: Jr-Jen Chen, Yu-Chien Liao, Hsi-Che Lin, Yu-Chu Yu, Yen-Chun Chen, Yu-Chiang Frank Wang
Under review: NeurIPS 2024 Datasets and Benchmarks Track.
[ Project Page ] [ arXiv ] [ Github ] [ Huggingface ] [ Leaderboard ]
Select and Distill: Selective Dual-Teacher Knowledge Transfer for Continual Learning on Vision-Language Models
Authors: Yu-Chu Yu, Chi-Pin Huang, Jr-Jen Chen, Kai-Po Chang, Yung-Hsuan Lai, Fu-En Yang, Yu-Chiang Frank Wang
Conference: European Conference on Computer Vision (ECCV), September 2024.
[ arXiv ]
Resume
Education
National Taiwan University
2023 - Present
Master of Graduate Institute of Communication Engineering
- GPA: 4.30 / 4.30
National Taiwan University
2019 - 2023
Bachelor of Mechanical Engineering
- GPA: 4.08 / 4.30
- Rank: 8 / 140
- Award: 3 times of Dean's List
Teaching Assistant
Awards
Certificate of Achievement of MOBILEHEROS 2021 CONNECTIVITY INNOVATION AWARDS
awarded by Bureau of Industry, Ministry of Economic Affairs
2nd of NASA 2020, INTERNATIONAL SPACE APP CHALLENGE
awarded by American Institute in Taiwan
Professional Experience
Graduate Student Researcher
2022 - Present
Vision and Learning Lab, Advisor: Yu-Chiang Frank Wang
Graduate Institute of Communication Engineering, National Taiwan University
- Multi-modal Large Langugage Models / Video Understanding
- Continual Learning on Vision-Language Models
- Diffusion Models Personalization
Undergraduate Student Researcher
2022.01 - 2022.08
Robot Learning Lab, Advisor: Shao-Hua Sun
Department of Electrical Engineering, National Taiwan University
- Reinforcement Learning
- Robot Manipulation
ADLINK Assistant Engineer
2022.07 - 2022.08
IoT Solutions & Technology Business Unit-Solution Architect & Technical Support
- Machine Learning / Anomaly Detection
- Edge Computation
Undergraduate Student Researcher
2021.08 - 2022.01
Bio-inspired Robotics Lab, Advisor: Pei-Chun Lin
Department of Mechanical Engineering, National Taiwan University
- Publication: EnveRob: Integration of an Intelligent Robotic Arm System for Mail Delivery Applications
- Object Dection / Depth Estimatioin
- Robot Operation System (ROS).
Projects
Adapt VLMs on Imitation Learning of Robotic Manipulation
Course: Reinforcement learning
Rank: 3 (out of all teams)
[ Slide ]
EnveRob: Integration of an Intelligent Robotic Arm System for Mail Delivery Applications
Publish in: 2023 International Conference on Advanced Robotics and Intelligent Systems (ARIS)
Authors: Shih-Huai Kao, Wei-Lin Pai, Feng-En Yeh, Jr-Jen Chen, Yu-Wei Lin, Pei-Chun Lin
[ IEEE ]
Skull Fracture Detection
Course: Deep learning for computer vision
Rank: 3 (out of all teams)
[ Poster ]