Publications

Understanding Masked Autoencoders via Hierarchical Latent Variable Models

Kong et al.

C2LIR: Continual Cross-Lingual Transfer for Low-Resource Information Retrieval

Lee et al.

Pre-processing Matters! Improved Wikipedia Corpora for Open-Domain Question Answering

Tamber, Pradeep & Lin

PyGaggle: A Gaggle of Resources for Open-Domain Question Answering

Pradeep et al.

Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation

Fu et al.

Towards Learning Emotion Information From Short Segments Of Speech

Purohit et al.

Magnushammer: A Transformer-based Approach to Premise Selection

Mikula et al.

Martingale Posterior Neural Processes

Lee et al.

Language-Driven Representation Learning for Robotics

Karamcheti et al.

DECIMER.ai - An open platform for automated optical chemical structure identification, segmentation and recognition in scientific publications

Rajan et al.

Toward denoising of 3D CT scans with few data

Liang et al.

DarijaBERT: A Step Forward in NLP for the Written Moroccan Dialect

Gaanoun et al.

AIOSA: An approach to the automatic identification of obstructive sleep apnea events based on deep learning

Bernardini et al.

Extracting the gamma-ray source-count distribution below the Fermi-LAT detection limit with deep learning

Amerio, Cuoco & Fornengo

Bioformer: an efficient transformer language model for biomedical text mining

Fang et al.

Evaluating generative patent language models

Lee

bart-base-japanese-news

Morinaga

Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling

Elnaggar et al.

Does progress on ImageNet transfer to real world datasets?

Fang, Kornblith & Schmidt

Benchmarking Robustness in Neural Radiance Fields

Wang et al.

Evaluating Cantonese Performance in NLP Systems

ToastyNews

SkinFormer: Robust Vision Transformer for Automatic Skin Disease Identification

Osman et al.

Generative Approach for Gender Rewriting Task with ArabicT5

Alrowili & Vijay-Shanker

Generating Classical Arabic Poetry using Pre-trained Models

ElOraby et al.

Cervical Cancer Screening on Multi-class Imbalanced Cervigram Dataset using Transfer Learning

Saini & Susan

Deep Learning Methodology for Early Detection and Outbreak Prediction of Invasive Species Growth

Elias

HINT: Hypernetwork Instruction Tuning for Efficient Zero-Shot Generalisation

Ivison et al.

Localization vs. Semantics: How Can Language Benefit Visual Representation Learning?

Li et al.

RoSummary: Control Tokens for Romanian News Summarization

Niculescu, Ruseti & Dascalu

Exploring Learning Rate Scaling Rules for Distributed ML Training on Transient Resources

André, Strati & Klimovic

ManyFold: an efficient and flexible library for training and validating protein folding models

Villegas-Morcillo et al.

Non-generalizability of biomarkers for mortality in SARS-CoV-2: a meta-analyses series

Shuvo et al.

CRMnet: a deep learning model for predicting gene expression from large regulatory sequence datasets

Ding et al.

The Effect of Data Dimensionality on Neural Network Prunability

Ankner et al.

UL2-small-nl24 for Finnish

Finnish-NLP

UL2-mini-nl8 for Finnish

Finnish-NLP

Receptive Field Refinement for Convolutional Neural Networks Reliably Improves Predictive Performance

Richter & Pal

NepBERTa: Nepali Language Model Trained in a Large Corpus

Gautam, Timilsina & Bhattarai

Debiasing Meta-Gradient Reinforcement Learning by Learning the Outer Value Function

Bonnet, Midgley & Laterre

MFinBERT: Multilingual Pretrained Language Model For Financial Domain

Nguyen et al.

Learning to Generate Data by Estimating Gradients of the Data Distribution

Song

Investigating Multilingual Approaches for Parsing Universal Dependencies

Barry

Posterior Matching for Arbitrary Conditioning

Strauss & Oliva

LERT: A Linguistically-motivated Pre-trained Language Model

Cui et al.

Harmonizing the object recognition strategies of deep neural networks with humans

Fel et al.

Individualized and Global Feature Attributions for Gradient Boosted Trees in the Presence of L2 Regularization

Sun

Generative adversarial networks and diffusion models in material discovery

Alverson et al.

UL2-tiny-nl6 for Finnish

Finnish-NLP

UL2-small-nl16 for Finnish

Finnish-NLP

UL2-base-nl36 for Finnish

Finnish-NLP

ArabicT5-Large

Alrowili & Shanker

Smol Imagen

Jenks

Offline RL With Realistic Datasets: Heteroskedasticity and Support Constraints

Singh et al.

Learning Probabilistic Models from Generator Latent Spaces with Hat EBM

Hill et al.

Pruning's Effect on Generalization Through the Lens of Training and Regularization

Jin et al.

ESB: A Benchmark For Multi-Domain End-to-End Speech Recognition

Gandhi, von Platen & Rush

Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models

Maroudas et al.

Instruction-Following Agents with Jointly Pre-Trained Vision-Language Models

Liu et al.

MetaFormer Baselines for Vision

Yu et al.

Do Language Models Understand Measurements?

Park, Ryu & Choi

Bioberturk: Exploring Turkish Biomedical Language Model Development Strategies in Low Resource Setting

Türkmen et al.

A Comprehensive Analysis of Subword Tokenizers for Morphologically Rich Languages

Erkaya

Optimizing Hierarchical Image VAEs for Sample Quality

Luhman & Luhman

MTet: Multi-domain Translation for English and Vietnamese

Ngo et al.

Integrative dissection of gene regulatory elements at base resolution

Chen et al.

EleutherAI: Going Beyond “Open Science” to “Science in the Open”

Phang et al.

IndoLib: A Natural Language Processing Toolkit for Low-Resource South Asian Languages

Timalsina

Pre-Training for Robots: Offline RL Enables Learning New Tasks from a Handful of Trials

Kumar et al.

ConserWeightive Behavioral Cloning for Reliable Offline Reinforcement Learning

Nguyen, Zheng & Grover

An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification

Chalkidis et al.

Population-Based Reinforcement Learning for Combinatorial Optimization

Grinsztajn, Furelos-Blanco & Barrett

Temporally Consistent Video Transformer for Long-Term Video Prediction

Yan et al.

The Effectiveness of Bidirectional Generative Patent Language Models

Lee

Hide and Seek in a Gridworld

Chen

More with Less: ZeroQA and Relevant Subset Selection for AI2 Reasoning Challenge

Patrascu et al.

Understanding Pure CLIP Guidance for Voxel Grid NeRF Models

Lee & Chang

Learning by Distilling Context

Snell, Klein & Zhong

GazeRadar: A Gaze and Radiomics-Guided Disease Localization Framework

Bhattacharya, Jain & Prasanna

A Light Recipe to Train Robust Vision Transformers

Debenedetti, Sehwag & Mittal

Developing Pretrained Language Models for Turkish Biomedical Domain

Türkmen et al.

Arabic machine reading comprehension on the Holy Qur'an using CL-AraBERT

Malhas & Elsayed

ZeRO Optimizer Sharding with jax.pmap

Fattori

Diabetic Retinopathy Screening using Deep Learning for Multi-class Imbalanced Datasets

Saini & Susan

JAX Synergistic Memory Inspector

Zhong

VisualRoBERTa

Vu

Stable Diffusion 2.1 Demo

Stability AI

Text-to-Text Multi-view Learning for Passage Re-ranking

Ju, Yang & Wang

Vision Transformers for End-to-End Particle Reconstruction for the CMS Experiment

Choudhury

Project Nabla

Chen

GPT-Neo Romanian 780M

Dumitrescu & Mihai

Denoising Diffusion Probabilistic Model in Flax

Xu

n-grammer-flax

Xu

Conviformers: Convolutionally guided Vision Transformer

Vaishnav et al.

ViP: Unified Certified Detection and Recovery for Patch Attack with Vision Transformers

Li, Zhang & Xie

Jumanji

InstaDeep

MaxxVit (CoAtNet, MaxVit, and related experimental weights)

Wightman

Masked Autoencoders Enable Efficient Knowledge Distillers

Bai et al.

NUS-IDS at CheckThat!2022: Identifying Check-worthiness of Tweets using CheckthaT5

Du, Gollapalli & Ng

Exploring Biomedical Question Answering with BioM-Transformers At BioASQ10B challenge: Findings and Techniques

Alrowili & Vijay-Shanker

Presentation on AR & VR work for the CIEHF

Pelham

TPU Research Cloud体験記 with JAX/Flax

Onishi

Fine-tuning DALL·E Mini (Craiyon) to Generate Blogpost Images

Turc

ConcreteDropout

Amerio

Is Attention always needed? A Case Study on Language Identification from Speech

Mandal et al.

On Automatic Summarization of Dutch Legal Cases

Prijs

AfriTeVa: Extending “Small Data” Pretraining Approaches to Sequence-to-Sequence Models

Ogundepo et al.

Lightweight Transformers for Conversational AI

Pressel et al.

SSBNet: Improving Visual Recognition Efficiency by Adaptive Sampling

Kwan & Song

Detecting and mitigating issues in image-based COVID-19 diagnosis

Silva, Rezende & Ponti

Recurrent Connections in the Primate Ventral Visual Stream Mediate a Trade-Off Between Task Performance and Network Size During Core Object Recognition

Nayebi et al.

StyleGAN2 Flax TPU

Müller & Laurent

Yes, No or IDK: The Challenge of Unanswerable Yes/No Questions

Sulem, Hay & Roth

Language Modelling with Pixels

Rust et al.

Use of Deep Learning to Detect the Maternal Heart Rate and False Signals on Fetal Heart Rate Recordings

Boudet et al.

Dutch T5 models : UL2, T5, ByT5 and Long-T5 🇳🇱🇧🇪

Havinga

Hironaka

Fan

BasqueGLUE: A Natural Language Understanding Benchmark for Basque

Urbizu et al.

Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation

Nam et al.

Evaluating Generative Patent Language Models

Lee

Thermalization and localization in isolated many-body quantum systems

Morningstar

Unified-IO

Lu et al.

Pre-training and Evaluating Transformer-based Language Models for Icelandic

Daðason & Loftsson

A Dense Representation Framework for Lexical and Semantic Matching

Lin & Lin

Insights into Pre-training via Simpler Synthetic Tasks

Wu, Li & Liang

Cachew: Machine Learning Input Data Processing as a Service

Graur et al.

Visualizing attention zones in machine reading comprehension models

Cui, Zhang & Liu

Edge Inference with Fully Differentiable Quantized Mixed Precision Neural Networks

Schaefer et al.

Xplique: A Deep Learning Explainability Toolbox

Fel et al.

DALL·E mini

Dayma

Can CNNs Be More Robust Than Transformers?

Wang et al.

Turtle Recall

Ivanov

Channelized Axial Attention - Considering Channel Relation within Spatial Attention for Semantic Segmentation

Huang et al.

Squeezeformer: An Efficient Transformer for Automatic Speech Recognition

Kim et al.

Describing Differences between Text Distributions with Natural Language

Zhong et al.

Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval

Notin et al.

t5_base_NCC

Kummervold

nafnet-jax

Li

EBM Life Cycle: MCMC Strategies for Synthesis, Defense, and Density Modeling

Hill et al.

hmBERT: Historical Multilingual Language Models for Named Entity Recognition

Schweter et al.

Multimodal Masked Autoencoders Learn Transferable Representations

Geng et al.

Zero-Shot and Few-Shot Learning for Lung Cancer Multi-Label Classification using Vision Transformer

Guo & Fan

Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval

Gao & Callan

Inception Transformer

Si et al.

Semi-self-supervised Automated ICD Coding

Hlynsson et al.

xcit

Dagli

Generating Disentangled Arguments With Prompts: A Simple Event Extraction Framework That Works

Si et al.

Multilingual multi-aspect explainability analyses on machine reading comprehension models

Cui et al.

ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language

Phan et al.

Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning

Liu et al.

Long Document Re-ranking with Modular Re-ranker

Gao & Callan

Experiments with big_vision

Paul

On the Design of 2D Human Pose Estimation Networks using Accelerated Neuroevolution and Novel Keypoint Representations

McNally

mae-jax

Yadav

ByT5-base for Finnish

Tanskanen & Toivanen

Hierarchical Label-wise Attention Transformer Model for Explainable ICD Coding

Liu et al.

Cross-stitched Multi-modal Encoders

Singla et al.

Multi-label topic classification for COVID-19 literature with Bioformer

Fang & Wang

Density Matrix Renormalization Group with Tensor Processing Units

Ganahl et al.

What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?

Wang et al.

Scalable Semi-Modular Inference with Variational Meta-Posteriors

Carmona & Nicholls

JAX Implementation of bart-base

Zhong

Neural Process Family

Yun

Pytorch Hyperparameter Optimization on TPUs

Suess

Code Clippy Github Dataset

Code.AI

Towards Efficient and Scalable Sharpness-Aware Minimization

Liu et al.

Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines

Kuchnik et al.

Skillful Precipitation Nowcasting — An Implementation of DeepMind's DGMR

Hassaan

Learning neural audio features without supervision

Yadav & Zeghidour

STaR: Bootstrapping Reasoning With Reasoning

Zelikman, Wu & Goodman

PACS: A Dataset for Physical Audiovisual CommonSense Reasoning

Yu et al.

TPU VM trained weight release w/ PyTorch XLA

Wightman

Dynamics of Transmon Ionization

Shillito et al.

KinyaBERT: a Morphology-aware Kinyarwanda Language Model

Nzeyimana & Rubungo

PERT: Pre-training BERT with permuted language model

Cui, Yang & Liu

Tevatron: An Efficient and Flexible Toolkit for Dense Retrieval

Gao et al.

Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons

Mohankumar & Khapra

IT5: Large-scale Text-to-text Pretraining for Italian Language Understanding and Generation

Sarti & Nissim

Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformers

Crothers et al.

The evolution, evolvability and engineering of gene regulatory DNA

Vaishnav et al.

Development of a Construction Specialized Pretrained Language Model

Kim

Slovak GPT-J-1.4B

Kondela

Recurrent Connections in the Primate Ventral Visual Stream Mediate a Tradeoff Between Task Performance and Network Size During Core Object Recognition

Nayebi et al.

TPU Starter

Mikazuki

audax

Yadav

CEDILLE: A large autoregressive language model in French

Müller & Laurent

Tensor Processing Units as Quantum Chemistry Supercomputers

Pederson et al.

Environment Classification for Robotic Leg Prostheses and Exoskeletons Using Deep Convolutional Neural Networks

Laschowski et al.

Icelandic ConvBERT-Base

Daðason

JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension

So et al.

Nordic ELECTRA-Small

Daðason

Icelandic-Norwegian ELECTRA-Small

Daðason

Our Summer of Code Project on TF-GAN

P A, Maynard-Reid & Shor

BioM-Transformers: Building Large Biomedical Language Models with BERT, ALBERT and ELECTRA

Alrowili & Vijay-Shanker

Interactive Gated Decoder for Machine Reading Comprehension

Cui et al.

Making and Using AI in the Library: Creating a BERT Model at the National Library of Sweden

Haffenden, Fano & Malmsten

A Large and Diverse Arabic Corpus for Language Modeling

Ali

MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound

Zellers et al.

GPT Neo 1.3B pre-trained on cleaned Dutch mC4 🇳🇱

Havinga

GPT-Neo 125M pre-trained on cleaned Dutch mC4 🇳🇱

Havinga

GPT2-Large pre-trained on cleaned Dutch mC4 🇳🇱

Havinga

Distributed Evolution Strategies Using TPUs for Meta-Learning

Sheng & He

Icelandic ELECTRA-Base

Daðason

Icelandic ELECTRA-Small

Daðason

NLP Tasks with GreekLegalBERT v2

Apostolopoulou & Briakos

BeerAI

Beckmann

Information retrieval and question answering: A case study on COVID-19 scientific literature

Otegi et al.

How and What to Learn: Taxonomizing Self-Supervised Learning for 3D Action Recognition

Tanfous et al.

BiCSNet: A Bidirectional Cross-Scale Backbone for Recognition and Localization

Peng et al.

Learned Queries for Efficient Local Attention

Arar, Shamir & Bermano

CPPE-5: Medical Personal Protective Equipment Dataset

Dagli & Shaikh

Contrastive Self-Supervised Pretraining of Vison Transformers

Cascio

GPT2-Medium pre-trained on cleaned Dutch mC4 🇳🇱

Havinga

T5-large pre-trained on cleaned Dutch mC4 🇳🇱

Havinga

Vision Transformer(ViT) in Tensorflow2

Lee

Large Scale Distributed Linear Algebra With Tensor Processing Units

Lewis et al.

Mask-combine Decoding and Classification Approach for Punctuation Prediction with real-time Inference Constraints

Minixhofer, Klejch & Bell

WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models

Minixhofer, Paischer & Rekabsaz

Simple Allocation Rules And Optimal Portfolio Choice Over The Lifecycle

Duarte

S3NAS: Fast Hardware-aware Neural Architecture Search Methodology

Lee et al.

Densifying Sparse Representations for Passage Retrieval by Representational Slicing

Lin & Lin

A Novel Method for Automated Identification and Prediction of Invasive Species Using Deep Learning

Elias

Interpreting intermediate feature representations of raw-waveform deep CNNs by sonification

Yadav

LASSL

Kim et al.

Chase World

Kassa

leaf-pytorch

Yadav

RoGPT2: Romanian GPT2 for Text Generation

Niculescu, Ruseti & Dascalu

ArabicTransformer: Efficient Large Arabic Language Model with Funnel Transformer and ELECTRA Objective

Alrowili & Vijay-Shanker

SkipResNet

Takeda

Poolformer

Sea AI Lab

Simulation of quantum physics with Tensor Processing Units: brute-force computation of ground states and time evolution

Hauru et al.

MetaFormer is Actually What You Need for Vision

Yu et al.

Building Keras from Source: A Follow-Along Guide

Kane

RoBERTuito: a pre-trained language model for social media text in Spanish

Pérez et al.

Historic Language Models (HLMs)

Schweter

Simulation of quantum many-body dynamics with Tensor Processing Units: Floquet prethermalization

Morningstar et al.

Solving Inverse Problems in Medical Imaging with Score-Based Generative Models

Song et al.

StaResGRU-CNN with CMedLMs:A stacked residual GRU-CNN with pre-trained biomedical language models for predictive intelligence

Ni et al.

AraBERTv0.2-Twitter

AUB Mind Lab

SIMONe

Le-Khac

DARLING: Deep leARning for chemicaL InformationprocessinG

Rajan

Do We Know What We Don't Know? Studying Unanswerable Questions beyond SQuAD 2.0

Sulem, Hay & Roth

Post-correction of OCR Results Using Pre-trained Language Model

Piotrowski

Search-Augmented Question Answering System Using Multilingual Transformer Model

Piotrowski

MutFormer: A context-dependent transformer-based model to predict pathogenic missense mutations

Jiang, Fang & Wang

Redesigning the Transformer Architecture with Insights from Multi-particle Dynamical Systems

Datta et al.

CrabNet for explainable deep learning in materials science: bridging the gap between academia and industry

Wang et al.

Multitask Prompted Training Enables Zero-Shot Task Generalization

Sanh et al.

SELECTRA: A Spanish ELECTRA

Fidalgo et al.

AIのべりすと

Kousin

Delphi: Towards Machine Ethics and Norms

Jiang et al.

The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design

Levine et al.

Cut the CARP: Fishing for zero-shot story evaluation

Matiana et al.

ResNet strikes back: An improved training procedure in timm

Wightman, Touvron & Jégou

Revisiting transposed convolutions for interpreting raw waveform sound event recognition CNNs by sonification

Yadav & Foster

Icelandic ConvBERT-Small

Daðason

Training on Test Data with Bayesian Adaptation for Covariate Shift

Zhou & Levine

O-JMeSH: creating a bilingual English-Japanese controlled vocabulary of MeSH UIDs through machine translation and mutual information

Soares et al.

JAX vs PyTorch: A simple transformer benchmark

Nolan

The Challenge of Appearance-Free Object Tracking with Feedforward Neural Networks

Malik et al.

AraT5: Text-to-Text Transformers for Arabic Language Understanding and Generation

Nagoudi, Elmadany & Abdul-Mageed

Clustering Monolingual Vocabularies to Improve Cross-Lingual Generalization

Bassani

Pretrained Neural Models for Turkish Text Classification

Okur & Sertbaş

Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations

Araujo et al.

BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation

Xu, Van Durme & Murray

ReasonBERT: Pre-trained to Reason with Distant Supervision

Deng et al.

gpt-c

Grankin

ChessCoach

Butner

Performance of chemical structure string representations for chemical image recognition using transformers

Rajan, Zielesny & Steinbeck

TUNiB-Electra

Kim et al.

An Approach to Extractive Bangla Question Answering Based On BERT-Bangla And BQuAD

Saha et al.

TRC로 월 몇만원에 GPU 수십개급의.. TPU 사용 가능

Lee

Characterizing Possible Failure Modes in Physics-Informed Neural Networks

Krishnapriyan et al.

An Empirical Exploration in Quality Filtering of Text Data

Gao

esmjax

Shafkat

Tpuddim

Diener

CodeGenX

DeepGenX

End-to-End Differentiability and Tensor Processing Unit Computing to Accelerate Materials' Inverse Design

Liu et al.

Understanding Attention in Machine Reading Comprehension

Cui et al.

huggingface를 이용한 한국어 BART 학습 후기

Park

Making of #IAN

Kirchner

End-to-end Biomedical Question Answering via Bio-AnswerFinder and Discriminative Language Representation Models

Ozyurt

Large Biomedical Question Answering Models with ALBERT and ELECTRA

Alrowili & Vijay-Shanker

Pretrained Transformers for Text Ranking: BERT and Beyond

Lin, Nogueira & Yates

Understanding The Computational Demands Underlying Visual Reasoning

Vaishnav et al.

Using Computational Analysis of Behavior To Discover Developmental Change In Memory-Guided Attention Mechanisms In Childhood

Amso et al.

Genji-python 6B

NovelAI

Vera: Prediction Techniques for Reducing Harmful Misinformation in Consumer Health Search

Pradeep et al.

Indonesian GPT-2 finetuned on Indonesian academic journals

Sahid

BioM-ALBERT-xxlarge

Alrowili

gaBERT — an Irish Language Model

Barry et al.

IndoT5-base

Akmal

Simple Allocation Rules and Optimal Portfolio Choice Over the Lifecycle

Duarte et al.

DiffIR: Exploring Differences in Ranking Models' Behavior

Jose et al.

FunMatch-Distillation

Paul

Exploiting Generative Self-Supervised Learning For The Assessment Of Biological Images With Lack Of Annotations: A Covid-19 Case-Study

Mascolini et al.

ViTGAN: Training GANs with Vision Transformers

Lee et al.

Exploring Listwise Evidence Reasoning with T5 for Fact Verification

Jiang, Pradeep & Lin

Environment Classification for Robotic Leg Prostheses and Exoskeletons using Deep Convolutional Neural Networks

Laschowski et al.

gpt-j-api 🦜

Gallego

Job Descriptions Keyword Extraction using Attention based Deep Learning Models with BERT

Mahdi et al.

SAT [Style Augmented Translation]

Luong

Dangers of Bayesian Model Averaging under Covariate Shift

Izmailov et al.

LV-BERT: Exploiting Layer Variety for BERT

Yu et al.

Accessing your TPUs in Docker Containers with TPU VM

Nguyen

Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study

Khemchandani et al.

Training Data Augmentation for Code-Mixed Translation

Gupta, Vavre & Sarawagi

GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model

Wang & Komatsuzaki

Concurrent Adversarial Learning for Large-Batch Training

Liu et al.

PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World

Zellers et al.

Which transformer architecture fits my data? A vocabulary bottleneck in self-attention

Wies et al.

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

Yao et al.

Wav2Vec2

Gupta

Flexible Architectures for Image Synthesis

Jain

EfficientNet JAX - Flax Linen and Objax

Wightman

TensorFlow Datasets IO (tfdsio)

Nguyen

Scientific Claim Verification with VERT5ERINI

Pradeep et al.

Detecting Anatomical and Functional Connectivity Relations in Biomedical Literature via Language Representation Models

Ozyurt et al.

BioELECTRA:Pretrained Biomedical text Encoder using Discriminators

Kanakarajan, Kundumani & Sankarasubbu

BioM-Transformers: Building Large Biomedical Language Models with BERT, ALBERT and ELECTRA

Alrowili & Vijay-Shanker

Stress Test Evaluation of Biomedical Word Embeddings

Araujo et al.

Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level

Zhong et al.

How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering

Jiang et al.

CoolMomentum: a method for stochastic optimization by Langevin dynamics with simulated annealing

Borysenko & Byshkin

Tensorflow2 기반 Seq2Seq 모델, 학습, 서빙 코드 구현

Park

DeepDarts: Modeling Keypoints as Objects for Automatic Scorekeeping in Darts using a Single Camera

McNally et al.

KLUE: Korean Language Understanding Evaluation

Park et al.

How Deep is your Learning: the DL-HARD Annotated Deep Learning Dataset

Mackie, Dalton & Yates

hebrew-gpt_neo

Adler

Unbiased Monte Carlo Cluster Updates with Autoregressive Neural Networks

Wu et al.

Contextualized Query Embeddings for Conversational Search

Lin, Yang & Lin

Mesh Transformer JAX

Wang

DECIMER1.0: Deep Learning for Chemical Image Recognition using Transformers

Rajan, Zielesny & Steinbeck

Clinical BERT Models Trained on Pseudo Re-identified MIMIC-III Notes

Lehman et al.

Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model

Kummervold et al.

Categorising Vaccine Confidence with TransformerBased Machine Learning Model: The Nuances of Vaccine Sentiment on Twitter

Kummervold et al.

City-Scale Simulation Of Covid-19 Pandemic & Intervention Policies Using Agent-Based Modelling

Suryawanshi et al.

CodeTrans: Towards Cracking the Language of Silicone's Code Through Self-Supervised Deep Learning and High Performance Computing

Elnaggar et al.

Arabic Compact Language Modelling for Resource Limited Devices

Alyafeai & Ahmad

Igor Ivanov: Harnessing Machine Learning Skills to Reduce Damages from Tropical Storms

Radiant Earth Foundation

Computer Vision and Deep Learning for Environment-Adaptive Control of Robotic Lower-Limb Exoskeletons

Laschowski et al.

InAugment: Improving Classifiers via Internal Augmentation

Arar, Shamir & Bermano

IndT5: A Text-to-Text Transformer for 10 Indigenous Languages

Nagoudi et al.

Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languages

Ramesh et al.

Self-Supervised Representation Learning with Relative Predictive Coding

Tsai et al.

Virtual Sensing and Sensors Selection for Efficient Temperature Monitoring in Indoor Environments

Brunello et al.

Horizontally Fused Training Array: An Effective Hardware Utilization Squeezer for Training Novel Deep Learning Models

Wang et al.

Comparing score aggregation approaches for document retrieval with pretrained transformers

Zhang, Yates & Lin

covid-19-IR with neural Reranking using Pseudo-qrels from the target collection

Elhuyar Foundation

MPII at the TREC 2020 Deep Learning Track

Li & Yates

The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models

Inoue et al.

Is Attention Better Than Matrix Decomposition?

Geng et al.

TPU Research Cloud — Free TPU Hardware for your Deep Learning Projects

Manai

TPUPoint: Automatic Characterization of Hardware-Accelerated Machine-Learning Behavior for Cloud Computing

Wudenhe & Tseng

UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark

Lourie et al.

Architext

Galanos

Score-Based Generative Modeling through Stochastic Differential Equations

Song et al.

I-BERT: Integer-only BERT Quantization

Kim et al.

A comprehensive fitness landscape model reveals the evolutionary history and future evolvability of eukaryotic cis-regulatory DNA sequences

Vaishnav et al.

ConvBERT: Improving BERT with Span-based Dynamic Convolution

Jiang et al.

Goal-Driven Recurrent Neural Network Models of the Ventral Visual Stream

Nayebi et al.

Introducing huBERT

Nemeskey

Symbolic regression for scientific discovery: an application to wind speed forecasting

Abdellaoui & Mehrkanoon

Text generation in GPT-2

a-emami

Time Series (re)sampling using Generative Adversarial Networks

Dahl & Sørensen

The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models

Pradeep, Nogueira & Lin

Hessian-Aware Pruning and Optimal Neural Implant

Yu et al.

A Multi-Class Hinge Loss for Conditional GANs

Kavalerov, Czaja & Chellappa

Bottleneck Transformers for Visual Recognition

Srinivas et al.

Distributed Evolution Strategies Using TPUs for Meta-Learning

Sheng & He

Few-Shot Question Answering by Pretraining Span Selection

Ram et al.

Neural Grammatical Error Correction for Romanian

Cotet, Ruseti & Dascalu

Progan-tensorflow2.x

Humbarwadi

Stress Testing of Meta-learning Approaches for Few-shot Learning

Aimen et al.

The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT

Pande et al.

Transfer Learning from Play and Language - Nailing the Baseline

Douglas

Adain-tensorflow2.x

Humbarwadi

Addressing Machine Learning Concept Drift Reveals Declining Vaccine Sentiment During the COVID-19 Pandemic

Müller & Salathé

ARAELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding

Antoun, Baly & Hajj

AraGPT2: Pre-Trained Transformer for Arabic Language Generation

Antoun, Baly & Hajj

ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic

Abdul-Mageed, Elmadany & Nagoudi

KcBERT

Beomi

PARSINLU:A Suite of Language Understanding Challenges for Persian

Khashabi et al.

RecipeNLG: A Cooking Recipes Dataset for Semi-Structured Text Generation

Bień et al.

STOUT: SMILES to IUPAC names using Neural Machine translation

Rajan, Zielesny & Steinbeck

The Depth-to-Width Interplay in Self-Attention

Levine et al.

TPUBar

Songz

Virtual Sensing of Temperatures in Indoor Environments: A Case Study

Brunello et al.

GottBERT: a pure German Language Model

Scheible et al.

HAWQ-V3: Dyadic Neural Network Quantization

Yao et al.

MEAD

Pressel

A Little Bit Is Worse Than None: Ranking with Limited Training Data

Zhang, Yates & Lin

An Empirical Study of Pre-trained Transformers for Arabic Information Extraction

Lan et al.

CLUE: A Chinese Language Understanding Evaluation Benchmark

Xu et al.

Cooking recipes generator utilizing a deep learning-based language model

Bień et al.

Ensemble Predictions of Wildfire Spread Through TPU-Compatible TensorFlow Acceleration

Bonanni & Ihme

Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks

Hui & Belkin

EvoPose2D: Pushing the Boundaries of 2D Human Pose Estimation using Neuroevolution

McNally et al.

German GPT-2 model

Bayerische Staatsbibliothek

Learning from Task Descriptions

Weller et al.

Malaya: Malay language Natural-Language-Toolkit

Zolkepli

Modern Control Technologies in Robotics

ΠΑΝΑΓΙΩΤΗΣ & ΧΑΤΖΟΠΟΥΛΟ

On the weak link between importance and prunability of attention heads

Budhraja et al.

UoS Participation in the WMT20 Translation of Biomedical Abstracts

Soares & Vaz

Διπλωματική Εργασία Σχεδίαση Αποδοτικών Μηχανισμών Προσοχής Για Βαθειά Νευρωνικά Δίκτυα

Δάρας

ExpMRC

Cui

An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks

Park et al.

Challenges in Zh-Ru MT Task and How to Overcome Them

Nazarov

Distilling Dense Representations for Ranking using Tightly-Coupled Teachers

Lin, Yang, Lin

Ensemble Predictions of Wildfire Spread Through TPU-Compatible TensorFlow Acceleration

Bonanni & Ihme

Flexible IR Pipelines with Capreolus

Yates et al.

German's Next Language Model

Chan, Schweter & Möller

Guiding Attention for Self-Supervised Learning with Transformers

Deshpande & Narasimhan

Identifying Learning Rules From Neural Network Observables

Nayebi et al.

LEGAL-BERT: The Muppets straight out of Law School

Chalkidis et al.

MammoGANesis: Controlled Generation of High-Resolution Mammograms for Radiology Education

Zakka et al.

ML Summit: Predict | Introduction to Swift for Tensorflow

Koonce

Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrastive Learning

Chang et al.

SMYRF: Efficient Attention using Asymmetric Clustering

Daras et al.

TPU VS GPU

Emami

WDN: A Wide and Deep Network to Divide-and-Conquer Image Super-resolution

Singh & Mittal

MacBERT

Cui

Plant Species Identification Using Transfer Learning-PlantCLEF 2020

Krishna, M & R

A Text to Text Approach for COVID-19 Event Extraction on Social Media

Wang

Application of Machine Learning Techniques for Text Generation

Román

Bangla BERT Base

Sarker

Deep multi-stations weather forecasting: explainable recurrent convolutional neural networks

Abdellaoui & Mehrkanoon

Dialogue Generation Models

Pingpong AI Research (Scatterlab)

Improving Dialog Evaluation with a Multi-reference Adversarial Dataset and Large Scale Pretraining

Sai et al.

IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages

Kakwani et al.

Retinanet-tensorflow2.x

Humbarwadi

S3NAS: Fast NPU-aware Neural Architecture Search Methodology

Lee, Kang & Ha

Ethical Detection of Online Influence Campaigns Using Transformer Language Models

Crothers

GREEK-BERT: The Greeks visiting Sesame Street

Koutsikakis et al.

HASeparator: Hyperplane-Assisted Softmax

Kansizoglou et al.

Introduction of ALBERT to understand Korean language in Financial domain with Transformers

Oh

PARADE: Passage Representation Aggregation for Document Reranking

Li et al.

PTT5: Pretraining and validating the T5 model on Brazilian Portuguese data

Carmo et al.

RECLOR: A Reading Comprehension Dataset Requiring Logical Reasoning

Yu et al.

A novel specific artificial intelligence-based method to identify COVID-19 cases using simple blood exams

Soares

Differentiable Augmentation for Data-Efficient GAN Training

Zhao et al.

Hong Kong Transformer Models And Other NLP Resources

出嚟食飯

Latent Retrieval for Large-Scale Fact-Checking and Question Answering with NLI training

Samarinas, Hsu & Lee

Lessons Learned from the Training of GANs on Artificial Datasets

Tang

Natural Language Processing Methods for Language Modeling

Nemeskey

NLP Reseach Project Part 2: How I (almost) replicated OpenAI's GPT-2 (124M version)

Khan

Playing with Words at the National Library of Sweden - Making a Swedish BERT

Malmsten, Borjeson & Haffenden

ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing

Elnaggar et al.

Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference

Kitaev & Klein

This Pony Does Not Exist

Arfa

Controlled Machine Text Generation of Football Articles

Garbus

Code Glyphs

Trenaman

Denoising Diffusion Probabilistic Models

Ho, Jain & Abbeel

EMOTIONET: A Multi-Convolutional Neural Network Hierarchical Approach to Facial and Emotional Classification using TPUs

D'Agostino & Schmidt

FinEst BERT and CroSloEngual BERT: less is more in multilingual models

Ulˇcar & Robnik-Sikonja

How the Google AI Community Used Cloud to Help Biomedical Researchers

Elliott, Kwon & Goncharov

Learning compact generalizable neural representations supporting perceptual grouping

Veerabadran & de Sa

On the Predictability of Pruning Across Scales

Rosenfeld et al.

Reproducible and Portable Workflows for Scientific Computing and HPC in the Cloud

Vaillancourt et al.

Swedish NLP Solutions for Email Classification

Castronuovo

Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers

Li et al.

Using TPUs with GCP and TFRC

Thomas

ทุนวิจัย Tensorflow Research Cloud ที่ให้พวกเราสามารถใช้ TPU ได้ฟรี 60 วัน!

Chatpatanasiri

Adaptation of Deep Bidirectional Transformers for Afrikaans Language

Ralethe

bert-japanese

Tohoku University

COVID-Twitter-BERT: A Natural Language Processing Model To Analyse COVID-19 Content On Twitter

Müller, Salathé & Kummervold

CURL: Contrastive Unsupervised Representations for Reinforcement Learning

Srinivas, Laskin & Abbeel

Deep Learning Training at Scale: Experiments with MLPerf on Multi-GPU and Multi-TPU Hardware

Verma

Establishing Baselines for Text Classification in Low-Resource Languages

Cruz & Cheng

Image Augmentation

Tan

iMaterialist (Fashion) 2020 at FGVC7 - 1st place solution

Polosin

Lexicon-Enhancement of Embedding-based Approaches Towards the Detection of Abusive Language

Koufakou & Scott

ParaPat: The Multi-Million Sentences Parallel Corpus of Patents Abstracts

Soares et al.

ParsBERT: Transformer-based Model for Persian Language Understanding

Farahani et al.

Query Reformulation using Query History for Passage Retrieval in Conversational Search

Lin et al.

Successfully Applying the Stabilized Lottery Ticket Hypothesis to the Transformer Architecture

Brix, Bahar & Ney

This Fursona Does Not Exist

Arfa

TPU-Tutorial

Diao

A Deep Learning Algorithm For The Diagnosis And Gleason Grading Of Whole Slide Images Of Prostate Cancer Core Biopsies

Kott et al.

Imitation Attacks and Defenses for Black-box Machine Translation Systems

Wallace, Stern & Song

Playing with machines: Using machine learning to understand automated copyright enforcement at scale

Gray & Suzor

Revisiting Pre-Trained Models for Chinese Natural Language Processing

Cui et al.

TensorFlow TPU 학습 101

Hong

TPU를 이용하여 Electra Pretraining하기

Park

A Not-so-Dangerous AI in the Persian Language

Khashei

CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Model

Xu, Zhang & Dong

Comparing Rewinding and Fine-tuning in Neural Network Pruning

Renda, Frankle & Carbin

Polbert

Kłeczek

The Limitations of Stylometry for Detecting Machine-Generated Fake News

Schuster et al.

Writing Persian Poetry with GPT-2.0

Khashei

🤗 + 📚 dbmdz BERT models

Bayerische Staatsbibliothek

AraBERT: Transformer-based Model for Arabic Language Understanding

Antoun, Baly & Hajj

bert-base-greek-uncased-v1

AUEB NLP Group

bert-base-swedish-cased-ner

National Library of Sweden

Discriminating between sleep and exercise-induced fatigue using computer vision and behavioral genetics

Schuch et al.

Going Much Wider with Deep Networks for Image Super-Resolution

Singh et al.

Improving the performance of convolutional neural network for the segmentation of optic disc in fundus images using attention gates and conditional random fields

Bhatkalkar et al.

Multi-focus Image Fusion Using Encoder-Decoder Network

Zhang

On Identifiability in Transformers

Brunner et al.

Redes neurais densamente conectadas para detecção de câncer de mama em imagens histopatológicas

Wentz

TensorFlow 2.1 with TPU in Practice

Lee

Two Routes to Scalable Credit Assignment without Weight Symmetry

Kunin et al.

Attention! A Lightweight 2D Hand Pose Estimation Approach

Santavas et al.

Running a pretrained model on Android with TPU

Cha

at16k

Shah

BERTje: A Dutch BERT Model

de Vries et al.

BETO

Rojas

Cross-Lingual Ability of Multilingual BERT: An Empirical Study

K et al.

Discriminative Sentence Modeling for Story Ending Prediction

Cui et al.

The Selection of Optimal Neural Network Hyperparameters

Akhmetzyanov

CLUE benchmark

Brightmart

Development of a Deep Learning Algorithm for the Histopathologic Diagnosis and Gleason Grading of Prostate Cancer Biopsies: A Pilot Study

Kott et al.

GPT2-ML

Caspar

High-Quality Cloud Masking of Landsat 8 Imagery Using Convolutional Neural Networks

Hughes & Kennedy

Personalized Patent Claim Generation and Measurement

Lee

TPU Pod Examples

D'Agostino

Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models

Daras et al.

Διαχείριση Πόρων σε Ετερογενείς Αρχιτεκτονικές με Εφαρμογή στο TensorFlow

Sofianídis

A Lite Bert For Self-Supervised Learning Language Representations

Brightmart

ChineseGLUE

Brightmart

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Raffel et al.

Localization of Fake News Detection via Multitask Transfer Learning

Cruz, Tan & Cheng

My experience with Cloud TPU

Akhmetzyanov

Parallel Iterative Edit Models for Local Sequence Transduction

Awasthi et al.

Report of using TPU Pod to pre-train a Japanese NLP model

Cong

Solving an object detection problem with Google's TPUs

Palvelev

Unsupervised Question Answering for Fact-Checking

Jobanputra

Answering questions by learning to rank -- Learning to rank by answering questions

Pîrtoacă, Rebedea & Ruseti

Benchmarking the Performance and Power of AI Accelerators for AI Training

Wang et al.

Cross-Lingual Machine Reading Comprehension

Cui et al.

GPT-2 Folk Music

Branwen

Reweighted Proximal Pruning for Large-Scale Language Representation

Guo et al.

RoBERTa for Chinese, TensorFlow & PyTorch

Brightmart

TFXL Translation

Rusia

TPU Tutorial

Kim

XLNet for Chinese, TensorFlow & PyTorch

Brightmart

bert4keras

Su

Chinese PreTrained XLNet

Cui et al.

OpenGPT-2: We Replicated GPT-2 Because You Can Too

Gokaslan & Cohen

Running PyTorch on TPU: a bag of tricks

Chikishev

Towards Ethical Content-Based Detection of Online Influence Campaigns

Crothers, Japkowicz & Victor

Training Deep Neural Networks on Google Tensor Processing Units (TPUs)

Tsoi

hanser

Shen

Benchmarking TPU, GPU, and CPU Platforms for Deep Learning

Wang, Wei & Brooks

Exploring the Use of Lexicons to aid Deep Learning towards the Detection of Abusive Language

Koufakou & Scott

Neural Machine Translation system for English to Vietnamese

Schweter

Single-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization

Stamoulis et al.

Use What You Have: Video Retrieval Using Representations From Collaborative Experts

Liu et al.

中文BERT-wwm

Cui

A Focus on Neural Machine Translation for African Languages

Martinus & Abbott

Benchmarking Neural Machine Translation for Southern African Languages

Martinus & Abbott

Comic2vec: Vector representation of comics

Piták

Disentangling neural mechanisms for perceptual grouping

Kim et al.

Evaluating Language Model Finetuning Techniques for Low-resource Languages

Cruz & Cheng

Neural Machine Translation Between English and Turkish

Ozkaya

Pre-Training with Whole Word Masking for Chinese BERT

Cui et al.

Replicating GPT2-1.5B

Leahy

Neural heuristics for SAT solving

Jaszczur et al.

Single-Path NAS: Device-Aware Efficient ConvNet Design

Stamoulis et al.

Fast Deep Neural Network Training on Distributed Systems and Cloud TPUs

You et al.

Single-Path NAS: Designing Hardware-Efficient ConvNets in less than 4 Hours

Stamoulis et al.

The Lottery Ticket Hypothesis at Scale

Frankle et al.

SCIBERT: Pretrained Contextualized Embeddings for Scientific Text

Beltagy, Cohan & Lo

Diagnose and Explain

d'Almeida

Large-Batch Training for LSTM and Beyond

You et al.

ART + AI — Generating African Masks using Tensorflow and TPUs

Dibia

Ensemble, Distill, and Fuse for Easy Video Labeling

Zhou et al.

Google Cloud TPU を使用して気づいたことなど

Suzuki

Quaternion convolutional neural networks for detection and localization of 3D sound events

Comminiello et al.

End-to-end sound source separation conditioned on instrument labels

Slizovskaia et al.

Mapping scRNA-seq data onto cell type taxonomies

Svensson & Pachter

Sample-efficient image segmentation through recurrence

Linsley, Kim & Serre

Task-Driven Convolutional Recurrent Models of the Visual System

Nayebi et al.

Automatic full compilation of Julia programs and ML models to Cloud TPUs

Fischer & Saba

Dostałem 105 TPU! Grant od TensorFlow Research Cloud!

Majek

Conditional WaveGAN

Lee et al.

Inferring travel activity pattern from Smartphone sensing data using deep learning

Ghorpade

Learning what and where to attend

Linsley et al.

Maximum Entropy Fine-Grained Classification

Dubey et al.

Some tips about using Google's TPU

Dong

A tutorial on using Google Cloud TPUs

Lee