arxiv:2406.10906
Kalle Hilsenbek
Bachstelze
AI & ML interests
Translation, syntax assessment, efficient modeling, synthetic data generation, and ethical reasoning
Recent Activity
posted an update 3 days ago
Master-Thesis: Syntax Probing of Instruction Models
Abstract:
This study aims to explore fundamental
linguistic abilities by systematically evaluating the impact of different datasets and language model architectures. Surprisingly, the tested instruction models are not very good at applying general grammar rules, especially for nonsensical but well-formed
sentences.
Download the full study as PDF-Version: https://gitlab.com/Bachstelze/syntax_transformer/-/blob/main/Abgabe-Syntax_probing_of_instruction_models.pdf
Datasets:
https://huggingface.co/datasets/Bachstelze/GEC_CoT_explanation
https://huggingface.co/datasets/Bachstelze/PAWS_CoT_explanation
Future research:
One might think about training the recent deepseek architecture as causal encoder-decoder and mitigate the wrong training objective of t5-models and readd the bi-directional potential to generative models. updated a Space 6 months ago
Bachstelze/pose-deep-learning updated a Space 7 months ago
Bachstelze/Round-Trip_Translation