Freelance AI Developers in BhiwandiFreelance AI Developers in Bhiwandi
AI Video Producer | Brand Designer
$25k+
Earned
19x
Hired
5.0
Rating
280
Followers
AI Video Producer | Brand Designer
I’m an AI & Machine Learning engineer with expertise in deve
I’m an AI & Machine Learning engineer with expertise in deve
Cover image for What your attention heatmap isn't
What your attention heatmap isn't telling you Everyone's staring at attention heatmaps and calling it "interpretability." Almost nobody's asking whether a single attention map actually tells you what the model used to make its decision. It doesn't. Not on its own. A raw attention map from layer 8 shows you what layer 8 attended to. It says nothing about how that signal got mixed, diluted, or overwritten by every layer before and after it. Attention rollout fixes this — and I built a walkthrough to show why it matters. Here's what makes it more than a "pretty heatmap" demo: Instead of visualizing one layer's attention, I traced how information actually flows through the full transformer stack. → Every layer's attention matrix is extracted, per head, per token → Multi-head attention is averaged, then combined with the residual connection (identity + attention) — this is the step most tutorials skip, and it's the one that actually matters → The combined matrices are matrix-multiplied layer by layer, rolling attention forward from input to output → The result: a single map showing genuine token-to-token influence across the entire network, not just one layer's snapshot The overlay shows you everything: → Per-layer attention vs. rolled-out attention, side by side → Token importance scores overlaid directly on the input text → A comparison view: which tokens raw attention says "matter" vs. which ones rollout says actually matter → Head-level breakdown so you can see which heads specialize vs. which are noise No black box. No "trust me, the model looked here." Just linear algebra, applied honestly across every layer instead of cherry-picking one. Built with PyTorch + HuggingFace Transformers + Matplotlib. Runs on any pretrained transformer, fully offline. ⚠️ Important: attention rollout is an approximation, not ground truth. It assumes attention is the primary information pathway, which ignores MLP layers and can still mislead for very deep models. Treat it as a debugging lens, not proof of causality.
0
107
Tech solutions with a product-first approach.
Tech solutions with a product-first approach.
AI & Web Products, SaaS & Mobile Apps | Product Designer
$10k+
Earned
1x
Hired
5.0
Rating
9
Followers
AI & Web Products, SaaS & Mobile Apps | Product Designer
Custom AI Assistants & Automated Workflows for Business
5.0
Rating
5
Followers
Custom AI Assistants & Automated Workflows for Business
Cover image for Mittu — Multilingual WhatsApp AI
Mittu — Multilingual WhatsApp AI Agent for Local Businesses The Problem: Small retail shop owners and local businesses in India don't want another bloated dashboard or complex management software. They want to type a quick message in their everyday language and get business handled immediately—logging orders, generating invoices, and checking sales without friction. The Solution: I built Mittu, a conversational AI assistant on WhatsApp designed specifically around how Indian retailers actually communicate. Mittu operates directly inside WhatsApp, allowing store owners to manage daily operations entirely in Hindi and Hinglish. Key Features & Capabilities: Conversational Order Intake: Parses multi-item orders with customer names and pricing directly from natural, free-form text. Automated GST Invoicing: Calculates tax breakdowns (GST @ 18%) and generates structured invoice numbers (INV-xxxx) on demand. On-Demand Business Intelligence: Summarizes daily and weekly revenue, top-selling items, and transaction logs via simple voice/text prompts. Natural Hindi/Hinglish Processing: Built to understand mixed-language phrasing, colloquial terms, and localized business terminology. Architecture & Tech Stack: Core Agent Logic: Python LLM Engine: Groq (LLaMA 3.3) for low-latency reasoning and conversational routing Database & Memory: Supabase for customer order history and transaction tracking Messaging Layer: Twilio WhatsApp Business API Pitch / Call to Action: Looking to build custom AI agents that automate customer operations or bridge English-only AI tools into local languages? Let's connect and build it.
0
52
AI Automation Engineer helping businesses run on autopilot
New to Contra
AI Automation Engineer helping businesses run on autopilot