Neural Mastery
← Practice
Practice: ALiBi (Attention with Linear Biases) From Scratchmedium

Practice: ALiBi (Attention with Linear Biases) From Scratch

mediumllms-genai⏱ 15–20 min
⚡ Libraries allowed · Pure Python earns +10 bonus XP
🎯 Mission
Implement Practice: ALiBi (Attention with Linear Biases) From Scratch and verify your implementation in the interactive AI/ML IDE workspace.

Task

Implement `alibi_positional_bias`. Libraries (NumPy, PyTorch, SciPy) are allowed, but Pure Python implementations earn bonus XP!

Function Signature

alibi_positional_bias(*args, **kwargs)

Examples

Example 1: Smoke Test
Input: {}
Output:
Explanation: Executes your function against default test inputs.

Constraints

  • Libraries (NumPy, PyTorch, SciPy) are allowed and accepted normally.
  • Pure Python (no external libraries) earns +10 Bonus XP!
  • Must handle edge cases (empty inputs, invalid shapes, boundary conditions) correctly.
Python3Saved ✓
def alibi_positional_bias(*args, **kwargs):
"""Implement Practice: ALiBi (Attention with Linear Biases) From Scratch.
Return the expected output according to the problem specification below."""
# Your implementation here
pass

Case 1: Smoke Test
Input: {}
Expected: