tinybert

深度学习入门课、资深课、特色课、学术案例、产业实践案例、深度学习知识百科及面试题库The course, case and knowledge of Deep Learning and AI

Build and train state-of-the-art natural language processing models using BERT

Code of the paper "Emotion Recognition on Edge Devices: Training and Deployment " by Pandelea et al.

To understand the gender/social bias Bert KD model, more specifically TinyBert.

PyTorch implementations of Encoder–Decoder Transformers, TinyBERT-style masked language modeling, and TinyGPT-style causal language modeling on the Tiny Shakespeare dataset, with training, evaluation metrics, and loss visualizations.

Sentiment analysis of Reddit posts and comments.

Federated Learning performance evaluation with Flower and PyTorch, comparing Full Fine-Tuning and LoRA Fine-Tuning in local and distributed environments.

DHWANI: a vision-guided UGV on a Jetson Nano that drives from point A to point B without GPS. Smart India Hackathon 2026, problem statement SIH26126 (BEL).

Software TinyBERT Development and Deployment

A comprehensive comparison of traditional machine learning and transformer-based models for fake news detection, developed as a Bachelor's graduation project at An-Najah National University.

Detect duplicate questions using NLP techniques including TF-IDF + Logistic Regression, Siamese LSTM, and TinyBERT Transformers. Built using the Quora Question Pairs dataset.

Public evaluation of OnKith's on-device PII span-detection model (TinyBERT-4, 67-label BIO). Entity-level F1, FP32 vs INT8 quantisation trade-off, and a probe showing part of the EMAIL score is domain memorisation. Notebook with committed outputs. No weights.

Twitter bot detection using TinyBERT + DNN — 93.25% accuracy with LIME explainability