Deep NLP @ CIS - LMU

All

40 repositories

cisnlp.github.io
Public
Homepage of cisnlp
academic-website
SCSS
•
MIT License
•2•3•0•0•Updated Dec 9, 2025Dec 9, 2025
multypo
Public
A Multilingual Keyboard Layout-Based Typo Generator
Python
•1•10•0•0•Updated Nov 23, 2025Nov 23, 2025
GlotLID
Public
💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023
language-detection multlingual language-detector language-recognition glot lid language-identification language-classification language-identification-toolkit low-resource-languages
Python
•
Apache License 2.0
•10•176•1•0•Updated Nov 19, 2025Nov 19, 2025
KLAR-CLC
Public
[ACL 2025] Lost in Multilinguality: Dissecting Cross-lingual Factual Inconsistency in Transformer Language Models
Python
•0•4•0•0•Updated Oct 26, 2025Oct 26, 2025
Language-Mixing
Public
[EMNLP 2025] Language Mixing in Reasoning Language Models: Patterns, Impact, and Internal Causes
Python
•0•1•0•0•Updated Oct 26, 2025Oct 26, 2025
manchu-in-context-mt
Public
Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu
Python
•1•9•0•0•Updated Sep 27, 2025Sep 27, 2025
GlotWeb
Public
🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
multilingual dataset glot low-resource-languages news-dataset awsome-list
Python
•
Creative Commons Zero v1.0 Universal
•0•17•4•0•Updated Aug 13, 2025Aug 13, 2025
MIB-circuit-track
Public
Python
•
Apache License 2.0
•0•0•0•0•Updated Aug 11, 2025Aug 11, 2025
spatial_intuitions
Public
Jupyter Notebook
•0•1•0•0•Updated May 27, 2025May 27, 2025
multilingual-fact-tracing
Public
Tracing Multilingual Factual Knowledge Acquisition in Pretraining
pretraining-data-detection multilingual-knowledge-acquisition fact-frequency factual-recall
Python
•2•6•1•0•Updated May 22, 2025May 22, 2025
MEXA
Public
🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment
multilingual evaluation embeddings evaluation-metrics cross-lingual multilingual-nlp large-language-models decoder-only
Python
•
Apache License 2.0
•1•11•0•0•Updated Apr 6, 2025Apr 6, 2025
GlotCC
Public
🕸 GlotCC Dataset and Pipline -- NeurIPS 2024
crawler multlingual corpus-linguistics glot language-identification commoncrawl common-crawl glotcc multilingual-dataset glotlid
Jupyter Notebook
•
Creative Commons Zero v1.0 Universal
•0•20•0•0•Updated Apr 6, 2025Apr 6, 2025
code-specific-neurons
Public
💻🔍 How Programming Concepts and Neurons Are Shared in Code Language Models
logitlens codellama code-language-model specific-neuron
Jupyter Notebook
•
Other
•2•9•1•0•Updated Mar 7, 2025Mar 7, 2025
relation-specific-neurons
Public
On Relation-Specific Neurons in Large Language Models
Python
•1•8•1•0•Updated Feb 25, 2025Feb 25, 2025
oscar-io
Public
Readers/Writers for GlotCC/OSCAR corpus
glotcc glotlid
Rust
•
Apache License 2.0
•1•1•0•0•Updated Oct 23, 2024Oct 23, 2024
ungoliant
Public
🕷️ The pipeline for the OSCAR/GlotCC corpus
glotcc glotlid
Rust
•
Apache License 2.0
•17•3•0•0•Updated Oct 23, 2024Oct 23, 2024
oscar-tools
Public
The original tooling for the GlotCC/OSCAR corpus rewritten in Rust
glotcc glotlid
Rust
•
Apache License 2.0
•3•1•0•0•Updated Oct 23, 2024Oct 23, 2024
2024fall-crosslingual-vlm-block-seminar
Public
Materials of 2024 Fall cross-lingual visual language models block seminar at LMU Munich.
Python
•0•2•0•0•Updated Oct 14, 2024Oct 14, 2024
LangSAMP
Public
LangSAMP: Language-Script Aware Multilingual Pretraining
multilingual language-embeddings continued-pretraining
Python
•0•3•0•0•Updated Sep 30, 2024Sep 30, 2024
analogical_reasoning
Public
JavaScript
•0•1•0•0•Updated Jul 28, 2024Jul 28, 2024
Transliteration-PPA
Public
Breaking the Script Barrier in Multilingual Pre-Trained Language Models with Transliteration-Based Post-Training Alignment
multilingual transliteration cross-lingual-transfer script-barrier
Python
•1•6•0•0•Updated Jul 3, 2024Jul 3, 2024
lohoravens-webpage
Public
JavaScript
•0•2•0•0•Updated Jun 28, 2024Jun 28, 2024
MaskLID
Public
💬 MaskLID: Code-Switching Language Identification through Iterative Masking -- ACL 2024
language-identification code-mixing code-switching language-identification-toolkit code-switch language-identifier
Python
•
MIT License
•3•10•0•1•Updated Jun 11, 2024Jun 11, 2024
GlotScript
Public
🖋 Resource and Tool for Writing System Identification -- LREC 2024
unicode script language-detection iso15924 alphabet unicode-characters writing-systems writing-system glot language-identification
Python
•
MIT License
•2•21•0•0•Updated Jun 7, 2024Jun 7, 2024
Taxi1500
Public
Python
•
Apache License 2.0
•0•11•1•0•Updated May 31, 2024May 31, 2024
TransMI
Public
TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data
transliteration multilinguality crosslingual-transfer tokenizer-modification
Python
•0•4•0•0•Updated May 30, 2024May 30, 2024
TransliCo
Public
TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models
transliteration multilinguality crosslingual-transfer script-barrier
Python
•1•9•0•0•Updated May 23, 2024May 23, 2024
Spatial_Schemas
Public
JavaScript
•0•1•0•0•Updated May 23, 2024May 23, 2024
XAMPLER
Public
XAMPLER: Learning to Retrieve Cross-Lingual In-Context Examples
Python
•0•2•0•0•Updated May 9, 2024May 9, 2024
Glot500
Public
Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
multilingual nlp natural-language-processing acl dataset glot xlm multilingual-models xlm-r multilingual-nlp
Python
•
Other
•4•106•2•0•Updated Apr 20, 2024Apr 20, 2024