😊 About Me
- 🌱 My research interests lie in agents based on large models (LLMs/MLMs). Specifically, I am interested in:
- 🔗 The integration of LMs with APIs (tools).
- 🛠 The software engineering challenges associated with the integration.
- 📱 The applications of LMs on edge devices.
- 📚 My research group primarily focuses on system software, including machine learning systems, serverless computing, web systems, software engineering, and etc. In my first year of Ph.D., I studied anomaly detection, federated learning, inference optimization for LLMs in the cloud, etc.
- 🔍 Throughout my studies from system software to deep learning, I have gained knowledge in various areas including methods and applications of natural language processing, retrieval systems, data analysis and mining, acceleration, and application of machine learning systems.
🔥 News
- 2024.07: A paper about LLM-based Agents submitted to arXiv, ShortcutsBench: A Large-Scale Real-World Benchmark for API-Based Agents.
- 2024.06: Became a PhD candidate in the School of Computer Science at Peking University.
- 2023.07: A paper in collaboration with Alibaba accepted by the International Conference on Web Services, ADPal: Automatic Detection of Troubled Users in Online Service Systems via Page Access Logs.
- 2022.09: Admitted as a PhD student in the School of Computer Science at Peking University.
- 2022.06: Received B.E degree from the School of Computer Science at Northwestern Polytechnical University.
- 2018.09: Admitted by the School of Computer Science at Northwestern Polytechnical University.
📝 Publications
- H. Shen, Y. Li, D. Meng, et al. “Shortcutsbench: A large-scale real-world benchmark for API-based agents,” 2024.
- H. Shen, Y. Ma, Y. Li, et al. “Adpal: Automatic detection of troubled users in online service systems via page access logs,” in 2023 IEEE International Conference on Web Services (ICWS), 2023, pp. 638–646.
- D. Tian, H. Shen, and Y. Ma, “Parallelizing DNN inference in mobile web browsers on heterogeneous hardware,” in Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services, MobiSys ‘22, Portland, Oregon: Association for Computing Machinery, 2022, pp. 519–520.
- ISBN: 9781450391856
- DOI: 10.1145/3498361.3538763
📖 Experience
-
Outstanding Research Award, Peking University (2022 ~ now)
- Ph.D. Candidate in Computer Science and Technology, School of Computer Science at Peking University (2022.09 - now)
- Ph.D. comprehensive exam: LLM, MLM, and LLM-based agent
- Researcher, Alibaba Innovative Researcher in Technical & Quality at Fliggy, Alibaba (2022.08 - 2022.10)
- Research topic: Anomaly detection using page access logs
-
National Scholarship, First Class Scholarship, and WU Yajun Scholarship, Northwestern Polytechnical University (2019 ~ 2021)
- B.Sc. in Computer Science and Technology, School of Computer Science at Northwestern Polytechnical University (2018.09 - 2022.07)
- Thesis: An Empirical Analysis of the Open Virtual Interaction Platform: Roblox