attention-mechanisms - 技术专题深度解读

Here are 80 public repositories matching this topic...

cmhungsteve / Awesome-Transformer-Attention

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

computer-vision deep-learning transformers transformer awesome-list vit papers attention-mechanism attention-mechanisms self-attention transformer-architecture transformer-models detr vision-transformer transformer-cv transformer-with-cv transformer-awesome visual-transformer

Updated Jul 30, 2024

pprp / awesome-attention-mechanism-in-cv

Star

Awesome List of Attention Modules and Plug&Play Modules in Computer Vision

computer-vision implementation attention-model attention-mechanisms pytorch-attention plugandplay vision-transformer

Updated May 11, 2023
Python

kyegomez / LongNet

Sponsor

Star

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

machine-learning artificial-intelligence transformer attention attention-is-all-you-need attention-mechanisms gpt3 gpt4 chatgpt context-length

Updated Jan 7, 2024
Python

JulesBelveze / time-series-autoencoder

Star

PyTorch Dual-Attention LSTM-Autoencoder For Multivariate Time Series

time-series pytorch forecasting autoencoder multivariate-timeseries attention-mechanisms lstm-autoencoder

Updated Nov 11, 2025
Python

changzy00 / pytorch-attention

Star

🦖Pytorch implementation of popular Attention Mechanisms, Vision Transformers, MLP-Like models and CNNs.🔥🔥🔥

cnns attention-mechanisms mlp-networks pytorch-implementation vits

Updated Jan 11, 2024
Python

landskape-ai / triplet-attention

Star

Official PyTorch Implementation for "Rotate to Attend: Convolutional Triplet Attention Module." [WACV 2021]

computer-vision deep-learning paper detection imagenet convolutional-neural-networks arxiv attention-mechanism attention-mechanisms gradcam triplet-attention

Updated Feb 11, 2025
Jupyter Notebook

cbaziotis / neat-vision

Star

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

visualization nlp natural-language-processing vuejs deep-learning attention deep-learning-library attention-mechanism text-visualization attention-mechanisms deep-learning-visualization self-attentive-rnn self-attention attention-visualization attention-scores

Updated May 4, 2018
Vue

vene / sparse-structured-attention

Star

Sparse and structured neural attention mechanisms

deep-neural-networks sparsity deep-learning sparse segmentation deeplearning attention-mechanism fused-lasso attention-mechanisms

Updated Aug 31, 2020
Python

GiantPandaCV / yolov3-point

Star

Learning YOLOv3 from scratch 从零开始学习YOLOv3代码

object-detection attention-mechanism plug-and-play attention-mechanisms yolov3

Updated Mar 14, 2022
Jupyter Notebook

kyegomez / MambaTransformer

Sponsor

Star

Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling

language machine-learning ai neural-network tensorflow pytorch recurrent-neural-networks artificial-intelligence neural-networks zeta ssm rnns attention-is-all-you-need attention-mechanisms multimodal gpt4

Updated Jan 30, 2026
Python

kyegomez / Jamba

Sponsor

Star

PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"

ai ml transformers artificial-neural-networks gpt attention-mechanism ssm attention-is-all-you-need attention-mechanisms

Updated Jan 17, 2026
Python

jshuadvd / LongRoPE

Star

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

nlp machine-learning natural-language-processing ai deep-learning transformers artificial-intelligence gpt language-model natural-language-inference natural tokenization natural-language-understanding attention-is-all-you-need attention-mechanisms transformer-architecture natural-language-procressing tokenizers llm

Updated Jul 20, 2024
Python

monk1337 / Various-Attention-mechanisms

Star

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras

keras pytorch attention attention-mechanism attention-model attention-mechanisms bahdanau-attention self-attention attention-lstm multi-head-attention hierarchical-attention sentence-attention luong-attention attention-network scaled-dot-product-attention

Updated Sep 23, 2021
Python

erogol / BlaGPT

Sponsor

Star

Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible experimentation and exploration.

machine-learning deep-learning transformers pytorch gpt attention-mechanisms gpt-2 position-embedding large-language-models llm llm-training hymba diffusion-llm dllm

Updated Jan 26, 2026
Python

kyegomez / SparseAttention

Sponsor

Star

Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"

machine-learning artificial-intelligence sparse-matrix attention-mechanism attention-is-all-you-need attention-mechanisms sparse-attn

Updated Jan 31, 2026
Python

johnsmithm / multi-heads-attention-image-classification

Star

Multi heads attention for image classification

computer-vision tensorflow keras attention-is-all-you-need attention-mechanisms

Updated Apr 19, 2018
Python

elbuco1 / AttentionMechanismsTrajectoryPrediction

Star

In this repository, one can find the code for my master's thesis project. The main goal of the project was to study and improve attention mechanisms for trajectory prediction of moving agents.

deep-learning social-interactions trajectory-prediction attention-mechanisms

Updated Oct 12, 2019
Python

DIAGNijmegen / prostateMR_3D-CAD-csPCa

Star

Hierarchical probabilistic 3D U-Net, with attention mechanisms (—𝘈𝘵𝘵𝘦𝘯𝘵𝘪𝘰𝘯 𝘜-𝘕𝘦𝘵, 𝘚𝘌𝘙𝘦𝘴𝘕𝘦𝘵) and a nested decoder structure with deep supervision (—𝘜𝘕𝘦𝘵++). Built in TensorFlow 2.5. Configured for voxel-level clinically significant prostate cancer detection in multi-channel 3D bpMRI scans.

mri-images computer-aided-detection attention-mechanisms prostate-cancer computer-aided-diagnosis seresnet tensorflow-keras unetplusplus attention-unet probabilistic-unet

Updated Feb 11, 2022
Python

subho406 / Sequence-to-Sequence-and-Attention-from-scratch-using-Tensorflow

Star

Sequence to Sequence and attention from scratch using Tensorflow

deep-learning tensorflow lstm attention sequence-to-sequence attention-mechanisms

Updated Sep 21, 2017
Jupyter Notebook

OBA-Research / VAAS

Star

VAAS is an inference-first, research-driven library for image integrity analysis. It integrates Vision Transformer Attention Mechanisms with patch-level self-consistency analysis to enable fine-grained localization and detection of visual inconsistencies across diverse image analysis tasks.

visualization research computer-vision deep-learning pytorch segmentation image-forensics hybrid-model anomaly-detection attention-mechanisms explainable-ai huggingface inference-api vision-transformers

Updated Jan 5, 2026
Python

Improve this page

Add a description, image, and links to the attention-mechanisms topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the attention-mechanisms topic, visit your repo's landing page and select "manage topics."

Learn more