SJTU Cross Media Language Intelligence Lab

All

41 repositories

SLAM-LLM
Public
Speech, Language, Audio, Music Processing with Large Language Model
speech-processing audio-processing peft music-processing large-language-model multimodal-large-language-models
Python
•
MIT License
•90•871•27•1•Updated Aug 7, 2025Aug 7, 2025
Mobile-Env
Public
A Universal Platform for Training and Evaluation of Mobile Interaction
nlp decision-making rl-environments interaction-platform rl-platform infoui information-ui
Python
•
Apache License 2.0
•6•51•1•0•Updated Jul 16, 2025Jul 16, 2025
x-lance.github.io
Public template
Welcome to X-LANCE! Cross Media Language Intelligence Lab in Shanghai Jiao Tong University.
HTML
•
MIT License
•12k•0•0•0•Updated Jul 7, 2025Jul 7, 2025
CogBench
Public
Python
•
Apache License 2.0
•0•6•0•0•Updated Jul 7, 2025Jul 7, 2025
Xmart
Public
Xmart青年论坛仓库，存放历史学生论坛和前沿讲座的视频回放和讲义，获取最新Xmart预告欢迎关注公众号【XLANCE Lab】
Apache License 2.0
•0•23•0•0•Updated Jun 28, 2025Jun 28, 2025
KWStreamingSearch
Public
Python
•5•67•1•0•Updated Jun 25, 2025Jun 25, 2025
kaiyu
Public
Kaiyu, Shanghai Jiao Tong University
HTML
•0•0•0•0•Updated Jun 19, 2025Jun 19, 2025
ToolHallucination
Public
[ICML 2024] Reducing Tool Hallucination via Reliability Alignment
Python
•
Apache License 2.0
•1•5•1•0•Updated Jun 17, 2025Jun 17, 2025
LinguaFranca
Public
Codes for paper "Converging to a Lingua Franca: Evolution of Linguistic Regions and Semantics Alignment in Multilingual Large Language Models"
Python
•0•5•0•0•Updated May 4, 2025May 4, 2025
RAGTalker
Public
HTML
•0•0•0•0•Updated Apr 3, 2025Apr 3, 2025
WebSRC-Baseline
Public
[EMNLP 2021] The baseline code for WebSRC dataset.
HTML
•
MIT License
•9•50•0•0•Updated Apr 2, 2025Apr 2, 2025
WebSRC
Public
[EMNLP 2021] WebSRC: A dataset for web based structural machine reading comprehension.
CSS
•0•5•0•0•Updated Apr 2, 2025Apr 2, 2025
Elearning-paper-reading
Public
0•0•0•0•Updated Dec 23, 2024Dec 23, 2024
VQTalker
Public
[AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization
Apache License 2.0
•0•50•4•0•Updated Dec 16, 2024Dec 16, 2024
MedEthicEval
Public
0•0•0•0•Updated Dec 2, 2024Dec 2, 2024
UniCATS-CTX-txt2vec
Public
[AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS
text-to-speech tts speech-synthesis acoustic-model unicats vq-diffusion ctx-txt2vec
Python
•8•64•5•0•Updated Nov 18, 2024Nov 18, 2024
MBS
Public
[COLING 2024] Multilingual Brain Surgeon: Large Language Models Can be Compressed Leaving No Language Behind
Python
•1•3•0•0•Updated Oct 12, 2024Oct 12, 2024
VoiceFlow-TTS
Public
[ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"
text-to-speech tts speech-synthesis probabilistic-models generative-models conditional-flow-matching rectified-flow-matching
Python
•24•356•8•0•Updated Sep 3, 2024Sep 3, 2024
AniTalker
Public
[ACM MM 2024] This is the official code for "AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding"
Jupyter Notebook
•
Apache License 2.0
•145•1.6k•9•0•Updated Aug 15, 2024Aug 15, 2024
META-GUI-Leaderboard
Public
[EMNLP 2022] Leaderboard of META-GUI
CSS
•0•0•0•0•Updated Jul 9, 2024Jul 9, 2024
META-GUI-baseline
Public
[EMNLP 2022] The baseline code for META-GUI dataset
Python
•
MIT License
•3•14•3•0•Updated Jul 9, 2024Jul 9, 2024
AttrEnhZsAc
Public
Python
•
Apache License 2.0
•0•5•0•0•Updated Jun 21, 2024Jun 21, 2024
UniCATS-CTX-vec2wav
Public
[AAAI 2024] Code for CTX-vec2wav in UniCATS
speech-synthesis vocoder semantic-token unicats vocoding self-supervised-speech
Python
•16•129•7•0•Updated Jun 11, 2024Jun 11, 2024
text2sql-multiturn-GPT
Public
[NAACL 2024] CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions
Python
•2•14•1•0•Updated May 7, 2024May 7, 2024
StoryTTS
Public
[ICASSP 2024] StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotations
HTML
•
Other
•4•139•2•0•Updated Apr 27, 2024Apr 27, 2024
weblm
Public
[WSDM 2024] Hierarchical Multimodal Pre-training for Visually Rich Webpage Understanding
1•15•2•0•Updated Mar 6, 2024Mar 6, 2024
MSDWILD
Public
[INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
HTML
•
Other
•1•52•1•0•Updated Jan 24, 2024Jan 24, 2024
text2sql-GPT
Public
[EMNLP 2023 Findings] ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thought
Python
•6•20•3•1•Updated Jan 11, 2024Jan 11, 2024
PsyAgents
Public
An Open-Source Psychotherapy Simulation Platform with Interactive Agents
0•0•0•0•Updated Jan 4, 2024Jan 4, 2024
PaperReading
Public
整理各研究方向经典论文
0•10•0•0•Updated Dec 4, 2023Dec 4, 2023