NLPTransformersDeep Learning
Understanding Transformer Architectures in Modern NLP
A deep dive into the attention mechanism and how transformers revolutionized natural language processing, from BERT to GPT and beyond.
March 15, 20248 min read
Shohanur Islam Sobuj
Hi, I'm
Shohanur Islam Sobuj.
I build _.
I'm a machine learning engineer specializing in AI, NLP, and computer vision. Currently, I'm focused on developing scalable ML infrastructure and conducting research in parameter-efficient fine-tuning of large language models.
01.
About Me
Hello! I'm Shohanur, and I enjoy creating intelligent systems that solve real-world problems. My journey into AI began with curiosity about how machines could learn and has evolved into expertise in Natural Language Processing, Computer Vision, and Biomedical Image Processing.
Fast-forward to today, and I've had the privilege of working at companies ranging from early-stage startups to established enterprises. My work spans from academic research published in top-tier venues to production-ready systems deployed at scale, handling millions of requests daily.
When I'm not at the computer, I'm usually exploring the latest developments in AI, contributing to open-source projects, or sharing knowledge through technical writing and mentoring aspiring ML engineers.
Here are a few technologies I've been working with recently:
Python
PyTorch
TensorFlow
Transformers
Docker
Kubernetes
Apache Kafka
MLOps
AWS/GCP
02.
Experience
Anymate Me GmbH
Current
Machine Learning Engineer
Dec 2024 - Present (11 m)Köln, GermanyFull-Time
Developing and deploying MLOps-driven ML solutions to streamline business processes
PythonTensorFlowPyTorchMLOpsDocker
Business Automation Ltd.
Machine Learning Engineer
Nov 2023 - Oct 2024 (1 yr)Dhaka, BangladeshFull-Time
Built scalable ML infrastructure and microservices. Managed CDC with MySQL using Debezium, Kafka, and Zookeeper. Delivered SmartRemarks and OCR-based TIN certificate validation system.
PythonKafkaDockerMySQLOCRNLP
Anchorblock Technology LLC
Machine Learning Engineer
May 2022 - Oct 2023 (1 yr, 6 m)Dhaka, BangladeshFull-Time
Developed large-scale distributed machine learning systems. Implemented MLOps principles including CI/CD for ML. Built diverse AI bots and designed APIs for ML/AI model integration.
PythonMLOpsCI/CDAPI DesignDistributed Systems
Self-Employed
Freelance Machine Learning Engineer
Jan 2019 - Apr 2022 (3 yrs, 4 m)RemoteFreelance
Collaborated with international clients to design, train, and deploy ML solutions across computer vision, NLP, and predictive analytics. Delivered 30+ projects including classification, object detection, and speech recognition models.
PythonPyTorchTensorFlowScikit-learnFastAPIOpenCVAWSDocker
03.
Featured Projects
L-TUNING: Synchronized Label Tuning
Published at ICLR 2024
Novel tuning methodology
Performance improvements on NLP benchmarks
A novel approach for prompt and prefix tuning in Large Language Models with synchronized label optimization. Published at ICLR 2024 Tiny Papers.
PyTorchTransformersLLMsFine-tuning
Rice Leaf Disease Classification
Transfer learning approach
High classification accuracy
Agricultural AI application
Leveraging Pre-trained CNNs for efficient feature extraction in rice leaf disease classification achieving high accuracy on agricultural datasets.
TensorFlowComputer VisionCNNTransfer Learning
Contrastive Learning for NLI
Zero-shot performance
Cross-lingual capabilities
EMNLP 2023 publication
Universal Zero-Shot Natural Language Inference with Cross-Lingual Sentence Embeddings using contrastive learning. Published at EMNLP 2023.
PythonNLPContrastive LearningMultilingual AI
04.
Publications
OCR-Enhanced Digital Signatures for Tamper-Proof Document Integrity Verification
Mohammad Majbah Uddin, Md. Shohanur Islam Sobuj
2025
2025 International Conference on Quantum Photonics, Artificial Intelligence, and Networking (QPAIN)
ConferenceLatest
PEFT A2Z: Parameter-Efficient Fine-Tuning Survey for Large Language and Vision Models
Nusrat Jahan Prottasha, Upama Roy Chowdhury, Shetu Mohanto, Tasfia Nuzhat, Abdullah As Sami, Md Shamol Ali, Md Shohanur Islam Sobuj, Hafijur Raman, Md Kowsher, Ozlem Ozmen Garibay
2025
arXiv preprint
Article
LLM-Mixer: Multiscale Mixing in LLMs for Time Series Forecasting
Md Kowsher, Md. Shohanur Islam Sobuj, Nusrat Jahan Prottasha, E. Alejandro Alanis, Ozlem Ozmen Garibay, Niloofar Yousefi
2025
arXiv preprint
Article
Parameter-efficient fine-tuning of large language models using semantic knowledge tuning
Nusrat Jahan Prottasha, Asif Mahmud, Md Shohanur Islam Sobuj, Prakash Bhat, Md Kowsher, Niloofar Yousefi, Ozlem Ozmen Garibay
2024
Scientific Reports
Article
Leveraging Pre-trained CNNs for Efficient Feature Extraction in Rice Leaf Disease Classification
Md. Shohanur Islam Sobuj, Md. Imran Hossen, Md. Foysal Mahmud, Mahbub Ul Islam Khan
2024
2024 International Conference on Advances in Computing, Communication, Electrical, and Smart Systems (iCACCESS)
Conference
05.
Latest Writing
Featured Posts
Recent Posts
Computer VisionMedical AIHealthcare
Computer Vision for Medical Imaging: OCT Analysis
Exploring how deep learning techniques can be applied to optical coherence tomography images for diabetic retinopathy diagnosis.
February 10, 202415 min read
Zero-Shot LearningNLITransfer Learning
Zero-Shot Learning in Natural Language Inference
How contrastive learning enables models to perform NLI tasks without task-specific training data, with practical implementations.
January 22, 202410 min read
InfrastructureKafkaDocker
Building Scalable ML Infrastructure with Kafka and Docker
A practical guide to setting up event-driven ML pipelines using Apache Kafka, Docker containers, and microservices architecture.
January 8, 202414 min read
Fine-tuningLLMTransfer Learning
Fine-tuning Large Language Models: A Comprehensive Guide
From prompt tuning to parameter-efficient methods, explore different approaches to adapt LLMs for specific tasks and domains.
December 18, 202318 min read
06.
Get In Touch
I'm always open to collaboration and new opportunities in AI research and development. Feel free to reach out if you'd like to discuss machine learning, research, or potential collaborations.
Or reach out directly at shohanur.ai@gmail.com
Prefer other ways to connect?