// Hi, my name is

Kelen Lv

Kelen Lv

AI Engineer (LLM / VLM) — China,Shanghai

China Mobile Shanghai Research Institute · Industrial Internet Innovation Dept.

I focus on enterprise-grade LLM and VLM algorithm development — analyzing capability gaps against real business scenarios, then designing the data, training, and evaluation loop that aligns large models to industry needs and ships them to production. My research spans LLM/VLM post-training, retrieval-augmented generation (RAG), multimodal alignment, and personalized federated learning, with papers at NeurIPS, Neural Computation, and Signal Processing.

Connect with me: GitHub ModelScope Blog

// Experience

China Mobile Shanghai Research Institute (CMSR) · Industrial Internet Innovation Dept. logo

AI Engineer (Golden Seed Talent Program)

Jul 2024 – Present
China Mobile Shanghai Research Institute (CMSR) · Industrial Internet Innovation Dept. · Full Time details
  • ▸As algorithm lead, drove the industry-analysis LLM and industrial/Tiangong multimodal LLM across industry search, report generation, and industrial image-text Q&A.
  • ▸Core algorithm developer on a central petroleum SOE's "AI+ process-operation assistance", designing a RAG + Grounded SFT scheme for evidence-grounded answering and refusal.
  • ▸Track and apply frontier techniques (spatio-temporal intelligence, multimodal, RL); author patents and papers.
LLMVLMRAGSFTLoRAGRPOCPTvLLMDeepSpeedLLaMA-Factoryms-SWIFTOpenCompassPyTorchLinuxAscend
Shanghai AI Lab · Smart Healthcare Dept. logo

Research Intern

May 2022 – Feb 2023
Shanghai AI Lab · Smart Healthcare Dept. · Internship details
  • ▸Applied split learning to assist training large models — shallow models on device, deep models in the cloud.
  • ▸Built a personalized federated-learning framework for data heterogeneity with significant gains across tasks; produced one SCI paper.
PythonPyTorchFederated LearningSplit LearningDistributed Optimization

// Education

Shanghai Jiao Tong University

Ph.D. in Control Science and Engineering

2018.09 – 2024.06
Shanghai Jiao Tong University · Full Time details
  • ▸Advisors: Prof. Jie Yang, Prof. Xiaolin Huang
  • ▸Thesis: Consensus algorithms under generalized eigenvalue problems and personalization
Wuhan University

B.Eng. in Communication Engineering

2014.09 – 2018.06
Wuhan University · Full Time details
  • ▸Recommended for direct Ph.D. admission
  • ▸Undergraduate thesis: person re-identification

// Featured Projects

Industrial (Tiangong) Multimodal LLM

In Progress
2026
China Mobile · Algorithm Lead

Targeting industrial natural images, mechanical drawings and time-series charts, analyzed generic-VLM gaps in domain semantics, spatial reasoning and process structure, designed an industrial vision-language alignment scheme and instruction-data system, and ran SFT and iteration to reach >75% image-text Q&A accuracy.

VLMSFTVision-Language Alignment

AI+ Process-Operation Assistance

In Production
2025.06
A central petroleum SOE · Core Algorithm Developer

For industrial-procedure Q&A, designed a RAG-based Grounded SFT alignment scheme giving the model evidence-grounded answering and refusal; end-to-end accuracy >84% and faithfulness >95%, shipped to production.

RAGGrounded SFTLLMAscend

Domestic On-Device Industrial Multimodal Understanding System

Open Source
2025.12
Alibaba Tongyi On-Device AI Innovation Challenge · Open-Source Impact Award

An industrial multimodal understanding system targeting domestic on-device hardware, covering industrial natural images and mechanical drawings; won the Open-Source Impact Award in the Alibaba Tongyi On-Device AI Innovation Challenge.

VLMOn-Device AIModelScopeTongyi

Industry-Analysis LLM

In Production
2024.12
China Mobile · Algorithm Lead

For industry search, governance and report generation, designed a "CPT + SFT + retrieval-augmented" scheme, built domain training data and an LLM-assisted data-production pipeline, and completed continual pre-training and LoRA tuning; lifted industry Q&A accuracy by 18% and cut data costs by 40%.

LLMCPTSFTLoRARAGvLLM

Personalized Federated-Learning Framework

2023.02
Shanghai AI Lab · Research Intern

Applied split learning to assist training large models (shallow on-device, deep in cloud) and proposed a personalized federated-learning framework introducing a dynamic "federation-collaboration degree"; significant gains across regression, prediction and classification, producing one SCI paper.

Federated LearningSplit LearningPyTorch

// Publications

Kernel PCA for Out-of-Distribution Detection via Random Features and Low-Rank Approximation

2026
IEEE Transactions on Pattern Analysis and Machine Intelligence · Journal Article · PUBLISHED

Hierarchical Temporal Views for Policy Optimization in Multimodal Video Reasoning

2025
ACM MM 2025 · Workshop on Large Vision-Language Model Learning and Applications · Conference Paper · PUBLISHED

Kernel PCA for Out-of-Distribution Detection

2024
Advances in Neural Information Processing Systems (NeurIPS'24) · Conference Paper · PUBLISHED

Learn What You Need in Personalized Federated Learning

2024
Neural Networks · Journal Article · UNDER REVIEW

Sparse Generalized Canonical Correlation Analysis: Distributed Alternating Iteration-Based Approach

2024
Neural Computation · Journal Article · PUBLISHED

Consensus-Based Distributed Algorithm for GEP

2024
Signal Processing · Journal Article · PUBLISHED

Respiratory Sound Classification by Applying the Deep Neural Network with the Blocking Variables

2023
Applied Sciences · Journal Article · PUBLISHED

One-shot Distributed Generalized Eigenvalue Problem (DGEP): Concept, Algorithm and Experiments

2022
Applied Sciences · Journal Article · PUBLISHED

Algorithm for Generalized Eigenvalue Problem

2022
Proceedings of the 2022 8th International Conference on Computing and Artificial Intelligence (ICCAI'22) · Conference Paper · PUBLISHED

One-Shot Distributed Algorithm for PCA with RBF Kernels

2021
IEEE Signal Processing Letters · Journal Article · PUBLISHED

// Technologies

LLM & VLM

LLMVLMRAGSFTLoRAGRPOTransformerVLAvLLMDeepSpeedLLaMA-Factoryms-SWIFT

ML & Optimization

PyTorchFederated LearningDistributed LearningADMMSparse OptimizationKernel MethodsMultimodal Fusion

Evaluation & Deployment

OpenCompassRAGASRagCheckerGradioAscend

Engineering & Tools

LinuxData PipelineTechnical Writing