Tuning-Free Longer Context Lengths For LLMs — A Review of Self-Extend (LLM Maybe LongLM)
LLMs are typically trained on fixed-length sequences, leading to performance degradation when dealing with longer texts due to …
Demystifying GQA — Grouped Query Attention for Efficient LLM Pre-training
The article explores Grouped Query Attention (GQA), an efficient pre-training strategy for large language models (LLMs) like LLaMA-2 …
Understanding LoRA — Low Rank Adaptation For Finetuning Large Models
Fine-tuning large pre-trained models is computationally challenging, often involving adjustment of millions of parameters. This …
Attention is all you need (Paper Notes)
Till 2017, the domain of language modelling, sequence to sequence learning, language translation, image captioning where all dominated …
Preflet: Get real-time predictive insights
This Portuguese based Data Science Startup is trying to make predictive analysis accessible to everyone using its next gen platform …
Linkedin opensources Avro2TF
Linkedin has always been a active contributor to the opensource community. April 4th, LinkedIn announced a new opensource project …
Blockchain?/! The Start of a new revolution
Today every big company you can think of is investing in Blockchain. From Tech giants like Microsoft and IBM to..
Training HaarCascade Model on Microsoft Azure.
Using Viola Jones algorithm to detect objects in realtime
Book Review: The Monk Who Sold His Ferrai
A book that will make you rethink about each and aspect of your life. The book is full of zen techniques to enrich your daily life and …
Quantum Computing and Microsoft Q#
Using Viola Jones algorithm to detect objects in realtime
