Neural Mastery
← Practice
Practice: Grouped Query Attention (GQA) From Scratchhard

Practice: Grouped Query Attention (GQA) From Scratch

hardllms-genai⏱ 15–20 min
⚡ Libraries allowed · Pure Python earns +10 bonus XP
🎯 Mission
Implement Practice: Grouped Query Attention (GQA) From Scratch and verify your implementation in the interactive AI/ML IDE workspace.

Task

Implement `grouped_query_attention`. Libraries (NumPy, PyTorch, SciPy) are allowed, but Pure Python implementations earn bonus XP!

Function Signature

grouped_query_attention(*args, **kwargs)

Examples

Example 1: Smoke Test
Input: {}
Output:
Explanation: Executes your function against default test inputs.

Constraints

  • Libraries (NumPy, PyTorch, SciPy) are allowed and accepted normally.
  • Pure Python (no external libraries) earns +10 Bonus XP!
  • Must handle edge cases (empty inputs, invalid shapes, boundary conditions) correctly.
Python3Saved ✓
def grouped_query_attention(*args, **kwargs):
"""Implement Practice: Grouped Query Attention (GQA) From Scratch.
Return the expected output according to the problem specification below."""
# Your implementation here
pass

Case 1: Smoke Test
Input: {}
Expected: