Publications

Beyond Model Efficiency: Data Optimizations for Machine Learning Systems

Kuchnik

An Inverse Scaling Law for CLIP Training

Li, Wang & Xie

Varta: A Large-Scale Headline-Generation Dataset for Indic Languages

Aralikatte et al.

Harnessing the Power of BERT in the Turkish Clinical Domain: Pretraining Approaches for Limited Data Scenarios

Türkmen et al.

Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation

Kirstain et al.

Enriching Biomedical Knowledge for Low-resource Language Through Large-Scale Translation

Phan et al.

Poisoning Language Models During Instruction Tuning

Wan et al.

Evaluation and optimization of sequence-based gene regulatory deep learning models

Rafi et al.

Improving Conversational Passage Re-ranking with View Ensemble

Ju et al.

PP-NAS: Searching for Plug-and-Play Blocks on Convolutional Neural Networks

Xiao et al.

Factorized visual representations in the primate visual system and deep neural networks

Lindsey & Issa

Differentiable RandAugment: Learning Selecting Weights and Magnitude Distributions of Image Transformations

Xiao et al.

Effect of Tokenization Granularity for Turkish Large Language Models

Kaya & Tantu

Astroformer: More Data Might Not be All You Need for Classification

Dagli

Reinforcement Learning from Passive Data via Latent Intentions

Ghosh, Bhateja & Levine

A Recipe for Training Large Models

Dayma

Automated Diagnosis Code Assignment of Thai Free-text Clinical Notes

Suvirat et al.

Polytuplet Loss: A Reverse Approach to Training Reading Comprehension and Logical Reasoning Models

Lu & Rodriguez

Reduce, Reuse, Recycle: Selective Reincarnation in Multi-Agent Reinforcement Learning

Formanek et al.

InceptionNeXt: When Inception Meets ConvNeXt

Yu et al.

Understanding Masked Autoencoders via Hierarchical Latent Variable Models

Kong et al.

C2LIR: Continual Cross-Lingual Transfer for Low-Resource Information Retrieval

Lee et al.

Pre-processing Matters! Improved Wikipedia Corpora for Open-Domain Question Answering

Tamber, Pradeep & Lin

PyGaggle: A Gaggle of Resources for Open-Domain Question Answering

Pradeep et al.

Importance of Aligning Training Strategy with Evaluation for Diffusion Models in 3D Multiclass Segmentation

Fu et al.

Towards Learning Emotion Information From Short Segments Of Speech

Purohit et al.

Magnushammer: A Transformer-based Approach to Premise Selection

Mikula et al.

Big Little Transformer Decoder

Kim et al.

Traversing Between Modes in Function Space for Fast Ensembling

Yun et al.

Decoupled Training for Long-Tailed Classification With Stochastic Representations

Nam, Jang & Lee

Connecting representation and generation via masked vision-language transformer

Geng et al.

Martingale Posterior Neural Processes

Lee et al.

Language-Driven Representation Learning for Robotics

Karamcheti et al.

DECIMER.ai - An open platform for automated optical chemical structure identification, segmentation and recognition in scientific publications

Rajan et al.

Toward denoising of 3D CT scans with few data

Liang et al.

DarijaBERT: A Step Forward in NLP for the Written Moroccan Dialect

Gaanoun et al.

AIOSA: An approach to the automatic identification of obstructive sleep apnea events based on deep learning

Bernardini et al.

Languages are Rewards: Hindsight Finetuning using Human Feedback

Liu, Sferrazza & Abbeel

Extracting the gamma-ray source-count distribution below the Fermi-LAT detection limit with deep learning

Amerio, Cuoco & Fornengo

Bioformer: an efficient transformer language model for biomedical text mining

Fang et al.

Ankh: Optimized Protein Language Model Unlocks General-Purpose Modelling

Elnaggar et al.

Does progress on ImageNet transfer to real world datasets?

Fang, Kornblith & Schmidt

Benchmarking Robustness in Neural Radiance Fields

Wang et al.

SkinFormer: Robust Vision Transformer for Automatic Skin Disease Identification

Osman et al.

Generative Approach for Gender Rewriting Task with ArabicT5

Alrowili & Vijay-Shanker

Generating Classical Arabic Poetry using Pre-trained Models

ElOraby et al.

Cervical Cancer Screening on Multi-class Imbalanced Cervigram Dataset using Transfer Learning

Saini & Susan

Deep Learning Methodology for Early Detection and Outbreak Prediction of Invasive Species Growth

Elias

HINT: Hypernetwork Instruction Tuning for Efficient Zero-Shot Generalisation

Ivison et al.

Localization vs. Semantics: How Can Language Benefit Visual Representation Learning?

Li et al.

RoSummary: Control Tokens for Romanian News Summarization

Niculescu, Ruseti & Dascalu

Exploring Learning Rate Scaling Rules for Distributed ML Training on Transient Resources

André, Strati & Klimovic

ManyFold: an efficient and flexible library for training and validating protein folding models

Villegas-Morcillo et al.

Non-generalizability of biomarkers for mortality in SARS-CoV-2: a meta-analyses series

Shuvo et al.

CRMnet: a deep learning model for predicting gene expression from large regulatory sequence datasets

Ding et al.

The Effect of Data Dimensionality on Neural Network Prunability

Ankner et al.

Receptive Field Refinement for Convolutional Neural Networks Reliably Improves Predictive Performance

Richter & Pal

NepBERTa: Nepali Language Model Trained in a Large Corpus

Gautam, Timilsina & Bhattarai

Debiasing Meta-Gradient Reinforcement Learning by Learning the Outer Value Function

Bonnet, Midgley & Laterre

MFinBERT: Multilingual Pretrained Language Model For Financial Domain

Nguyen et al.

Learning to Generate Data by Estimating Gradients of the Data Distribution

Song

Investigating Multilingual Approaches for Parsing Universal Dependencies

Barry

Posterior Matching for Arbitrary Conditioning

Strauss & Oliva

LERT: A Linguistically-motivated Pre-trained Language Model

Cui et al.

Harmonizing the object recognition strategies of deep neural networks with humans

Fel et al.

Individualized and Global Feature Attributions for Gradient Boosted Trees in the Presence of L2 Regularization

Sun

Generative adversarial networks and diffusion models in material discovery

Alverson et al.

Offline RL With Realistic Datasets: Heteroskedasticity and Support Constraints

Singh et al.

Learning Probabilistic Models from Generator Latent Spaces with Hat EBM

Hill et al.

Pruning's Effect on Generalization Through the Lens of Training and Regularization

Jin et al.

ESB: A Benchmark For Multi-Domain End-to-End Speech Recognition

Gandhi, von Platen & Rush

Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models

Maroudas et al.

Instruction-Following Agents with Jointly Pre-Trained Vision-Language Models

Liu et al.

MetaFormer Baselines for Vision

Yu et al.

Do Language Models Understand Measurements?

Park, Ryu & Choi

Bioberturk: Exploring Turkish Biomedical Language Model Development Strategies in Low Resource Setting

Türkmen et al.

A Comprehensive Analysis of Subword Tokenizers for Morphologically Rich Languages

Erkaya

Optimizing Hierarchical Image VAEs for Sample Quality

Luhman & Luhman

MTet: Multi-domain Translation for English and Vietnamese

Ngo et al.

Integrative dissection of gene regulatory elements at base resolution

Chen et al.

EleutherAI: Going Beyond “Open Science” to “Science in the Open”

Phang et al.

IndoLib: A Natural Language Processing Toolkit for Low-Resource South Asian Languages

Timalsina

Pre-Training for Robots: Offline RL Enables Learning New Tasks from a Handful of Trials

Kumar et al.

ConserWeightive Behavioral Cloning for Reliable Offline Reinforcement Learning

Nguyen, Zheng & Grover

An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification

Chalkidis et al.

Population-Based Reinforcement Learning for Combinatorial Optimization

Grinsztajn, Furelos-Blanco & Barrett

Temporally Consistent Video Transformer for Long-Term Video Prediction

Yan et al.

The Effectiveness of Bidirectional Generative Patent Language Models

Lee

Hide and Seek in a Gridworld

Chen

More with Less: ZeroQA and Relevant Subset Selection for AI2 Reasoning Challenge

Patrascu et al.

Understanding Pure CLIP Guidance for Voxel Grid NeRF Models

Lee & Chang

Learning by Distilling Context

Snell, Klein & Zhong

GazeRadar: A Gaze and Radiomics-Guided Disease Localization Framework

Bhattacharya, Jain & Prasanna

A Light Recipe to Train Robust Vision Transformers

Debenedetti, Sehwag & Mittal

Developing Pretrained Language Models for Turkish Biomedical Domain

Türkmen et al.

Arabic machine reading comprehension on the Holy Qur'an using CL-AraBERT

Malhas & Elsayed

Diabetic Retinopathy Screening using Deep Learning for Multi-class Imbalanced Datasets

Saini & Susan

Text-to-Text Multi-view Learning for Passage Re-ranking

Ju, Yang & Wang

Project Nabla

Chen

Conviformers: Convolutionally guided Vision Transformer

Vaishnav et al.

ViP: Unified Certified Detection and Recovery for Patch Attack with Vision Transformers

Li, Zhang & Xie

Masked Autoencoders Enable Efficient Knowledge Distillers

Bai et al.

NUS-IDS at CheckThat!2022: Identifying Check-worthiness of Tweets using CheckthaT5

Du, Gollapalli & Ng

Exploring Biomedical Question Answering with BioM-Transformers At BioASQ10B challenge: Findings and Techniques

Alrowili & Vijay-Shanker

Presentation on AR & VR work for the CIEHF

Pelham

TPU Research Cloud体験記 with JAX/Flax

Onishi

Fine-tuning DALL·E Mini (Craiyon) to Generate Blogpost Images

Turc

Is Attention always needed? A Case Study on Language Identification from Speech

Mandal et al.

On Automatic Summarization of Dutch Legal Cases

Prijs

AfriTeVa: Extending “Small Data” Pretraining Approaches to Sequence-to-Sequence Models

Ogundepo et al.

Lightweight Transformers for Conversational AI

Pressel et al.

SSBNet: Improving Visual Recognition Efficiency by Adaptive Sampling

Kwan & Song

Detecting and mitigating issues in image-based COVID-19 diagnosis

Silva, Rezende & Ponti

Recurrent Connections in the Primate Ventral Visual Stream Mediate a Trade-Off Between Task Performance and Network Size During Core Object Recognition

Nayebi et al.

BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla

Bhattacharjee et al.

Yes, No or IDK: The Challenge of Unanswerable Yes/No Questions

Sulem, Hay & Roth

Language Modelling with Pixels

Rust et al.

Use of Deep Learning to Detect the Maternal Heart Rate and False Signals on Fetal Heart Rate Recordings

Boudet et al.

BasqueGLUE: A Natural Language Understanding Benchmark for Basque

Urbizu et al.

Improving Ensemble Distillation With Weight Averaging and Diversifying Perturbation

Nam et al.

Evaluating Generative Patent Language Models

Lee

Thermalization and localization in isolated many-body quantum systems

Morningstar

Unified-IO

Lu et al.

Pre-training and Evaluating Transformer-based Language Models for Icelandic

Daðason & Loftsson

A Dense Representation Framework for Lexical and Semantic Matching

Lin & Lin

Insights into Pre-training via Simpler Synthetic Tasks

Wu, Li & Liang

Cachew: Machine Learning Input Data Processing as a Service

Graur et al.

Visualizing attention zones in machine reading comprehension models

Cui, Zhang & Liu

Edge Inference with Fully Differentiable Quantized Mixed Precision Neural Networks

Schaefer et al.

Xplique: A Deep Learning Explainability Toolbox

Fel et al.

Can CNNs Be More Robust Than Transformers?

Wang et al.

Channelized Axial Attention - Considering Channel Relation within Spatial Attention for Semantic Segmentation

Huang et al.

Squeezeformer: An Efficient Transformer for Automatic Speech Recognition

Kim et al.

Divide to adapt: Mitigating confirmation bias for domain adaptation of black-box predictors

Yang et al.

FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders

Wang et al.

Alignment-Augmented Consistent Translation for Multilingual Open Information Extraction

Kolluru et al.

Describing Differences between Text Distributions with Natural Language

Zhong et al.

Tranception: protein fitness prediction with autoregressive transformers and inference-time retrieval

Notin et al.

EBM Life Cycle: MCMC Strategies for Synthesis, Defense, and Density Modeling

Hill et al.

hmBERT: Historical Multilingual Language Models for Named Entity Recognition

Schweter et al.

Multimodal Masked Autoencoders Learn Transferable Representations

Geng et al.

Zero-Shot and Few-Shot Learning for Lung Cancer Multi-Label Classification using Vision Transformer

Guo & Fan

Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval

Gao & Callan

Inception Transformer

Si et al.

BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla

Bhattacharjee et al.

Semi-self-supervised Automated ICD Coding

Hlynsson et al.

xcit

Dagli

Generating Disentangled Arguments With Prompts: A Simple Event Extraction Framework That Works

Si et al.

Multilingual multi-aspect explainability analyses on machine reading comprehension models

Cui et al.

ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language

Phan et al.

Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning

Liu et al.

Long Document Re-ranking with Modular Re-ranker

Gao & Callan

Odor Descriptor Understanding through Prompting

Sisson

On the Design of 2D Human Pose Estimation Networks using Accelerated Neuroevolution and Novel Keypoint Representations

McNally

Reliable label correction is a good booster when learning with extremely noisy labels

Wang et al.

Adversarially robust vision transformers

Debenedetti

Hierarchical Label-wise Attention Transformer Model for Explainable ICD Coding

Liu et al.

Cross-stitched Multi-modal Encoders

Singla et al.

Multi-label topic classification for COVID-19 literature with Bioformer

Fang & Wang

Density Matrix Renormalization Group with Tensor Processing Units

Ganahl et al.

What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?

Wang et al.

Scalable Semi-Modular Inference with Variational Meta-Posteriors

Carmona & Nicholls

Learning Generative Models with Energy-Based Models and Transformer GANs

Lee

Pytorch Hyperparameter Optimization on TPUs

Suess

Towards Efficient and Scalable Sharpness-Aware Minimization

Liu et al.

Plumber: Diagnosing and Removing Performance Bottlenecks in Machine Learning Data Pipelines

Kuchnik et al.

Skillful Precipitation Nowcasting — An Implementation of DeepMind's DGMR

Hassaan

Learning neural audio features without supervision

Yadav & Zeghidour

STaR: Bootstrapping Reasoning With Reasoning

Zelikman, Wu & Goodman

PACS: A Dataset for Physical Audiovisual CommonSense Reasoning

Yu et al.

Dynamics of Transmon Ionization

Shillito et al.

KinyaBERT: a Morphology-aware Kinyarwanda Language Model

Nzeyimana & Rubungo

PERT: Pre-training BERT with permuted language model

Cui, Yang & Liu

Tevatron: An Efficient and Flexible Toolkit for Dense Retrieval

Gao et al.

Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons

Mohankumar & Khapra

IT5: Large-scale Text-to-text Pretraining for Italian Language Understanding and Generation

Sarti & Nissim

Adversarial Robustness of Neural-Statistical Features in Detection of Generative Transformers

Crothers et al.

The evolution, evolvability and engineering of gene regulatory DNA

Vaishnav et al.

Mastering the Game of Abalone using Deep Reinforcement Learning and Self-Play

Claußen

Development of a Construction Specialized Pretrained Language Model

Kim

audax

Yadav

CEDILLE: A large autoregressive language model in French

Müller & Laurent

Tensor Processing Units as Quantum Chemistry Supercomputers

Pederson et al.

Environment Classification for Robotic Leg Prostheses and Exoskeletons Using Deep Convolutional Neural Networks

Laschowski et al.

JaQuAD: Japanese Question Answering Dataset for Machine Reading Comprehension

So et al.

Our Summer of Code Project on TF-GAN

P A, Maynard-Reid & Shor

BioM-Transformers: Building Large Biomedical Language Models with BERT, ALBERT and ELECTRA

Alrowili & Vijay-Shanker

Interactive Gated Decoder for Machine Reading Comprehension

Cui et al.

Making and Using AI in the Library: Creating a BERT Model at the National Library of Sweden

Haffenden, Fano & Malmsten

A Large and Diverse Arabic Corpus for Language Modeling

Ali

MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound

Zellers et al.

Distributed Evolution Strategies Using TPUs for Meta-Learning

Sheng & He

NLP Tasks with GreekLegalBERT v2

Apostolopoulou & Briakos

BeerAI

Beckmann

Information retrieval and question answering: A case study on COVID-19 scientific literature

Otegi et al.

How and What to Learn: Taxonomizing Self-Supervised Learning for 3D Action Recognition

Tanfous et al.

BiCSNet: A Bidirectional Cross-Scale Backbone for Recognition and Localization

Peng et al.

Learned Queries for Efficient Local Attention

Arar, Shamir & Bermano

CPPE-5: Medical Personal Protective Equipment Dataset

Dagli & Shaikh

Large Scale Distributed Linear Algebra With Tensor Processing Units

Lewis et al.

Mask-combine Decoding and Classification Approach for Punctuation Prediction with real-time Inference Constraints

Minixhofer, Klejch & Bell

WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models

Minixhofer, Paischer & Rekabsaz

Simple Allocation Rules And Optimal Portfolio Choice Over The Lifecycle

Duarte

S3NAS: Fast Hardware-aware Neural Architecture Search Methodology

Lee et al.

Densifying Sparse Representations for Passage Retrieval by Representational Slicing

Lin & Lin

A Novel Method for Automated Identification and Prediction of Invasive Species Using Deep Learning

Elias

Interpreting intermediate feature representations of raw-waveform deep CNNs by sonification

Yadav

RoGPT2: Romanian GPT2 for Text Generation

Niculescu, Ruseti & Dascalu

ArabicTransformer: Efficient Large Arabic Language Model with Funnel Transformer and ELECTRA Objective

Alrowili & Vijay-Shanker

Simulation of quantum physics with Tensor Processing Units: brute-force computation of ground states and time evolution

Hauru et al.

MetaFormer is Actually What You Need for Vision

Yu et al.

Building Keras from Source: A Follow-Along Guide

Kane

RoBERTuito: a pre-trained language model for social media text in Spanish

Pérez et al.

Simulation of quantum many-body dynamics with Tensor Processing Units: Floquet prethermalization

Morningstar et al.

Solving Inverse Problems in Medical Imaging with Score-Based Generative Models

Song et al.

StaResGRU-CNN with CMedLMs:A stacked residual GRU-CNN with pre-trained biomedical language models for predictive intelligence

Ni et al.

DARLING: Deep leARning for chemicaL InformationprocessinG

Rajan

Do We Know What We Don't Know? Studying Unanswerable Questions beyond SQuAD 2.0

Sulem, Hay & Roth

Post-correction of OCR Results Using Pre-trained Language Model

Piotrowski

Search-Augmented Question Answering System Using Multilingual Transformer Model

Piotrowski

MutFormer: A context-dependent transformer-based model to predict pathogenic missense mutations

Jiang, Fang & Wang

Redesigning the Transformer Architecture with Insights from Multi-particle Dynamical Systems

Datta et al.

CrabNet for explainable deep learning in materials science: bridging the gap between academia and industry

Wang et al.

Multitask Prompted Training Enables Zero-Shot Task Generalization

Sanh et al.

AIのべりすと

Kousin

Delphi: Towards Machine Ethics and Norms

Jiang et al.

The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design

Levine et al.

Cut the CARP: Fishing for zero-shot story evaluation

Matiana et al.

ResNet strikes back: An improved training procedure in timm

Wightman, Touvron & Jégou

Revisiting transposed convolutions for interpreting raw waveform sound event recognition CNNs by sonification

Yadav & Foster

Training on Test Data with Bayesian Adaptation for Covariate Shift

Zhou & Levine

O-JMeSH: creating a bilingual English-Japanese controlled vocabulary of MeSH UIDs through machine translation and mutual information

Soares et al.

JAX vs PyTorch: A simple transformer benchmark

Nolan

The Challenge of Appearance-Free Object Tracking with Feedforward Neural Networks

Malik et al.

AraT5: Text-to-Text Transformers for Arabic Language Understanding and Generation

Nagoudi, Elmadany & Abdul-Mageed

Clustering Monolingual Vocabularies to Improve Cross-Lingual Generalization

Bassani

Pretrained Neural Models for Turkish Text Classification

Okur & Sertbaş

Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations

Araujo et al.

BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation

Xu, Van Durme & Murray

ReasonBERT: Pre-trained to Reason with Distant Supervision

Deng et al.

ChessCoach

Butner

Performance of chemical structure string representations for chemical image recognition using transformers

Rajan, Zielesny & Steinbeck

An Approach to Extractive Bangla Question Answering Based On BERT-Bangla And BQuAD

Saha et al.

TRC로 월 몇만원에 GPU 수십개급의.. TPU 사용 가능

Lee

Characterizing Possible Failure Modes in Physics-Informed Neural Networks

Krishnapriyan et al.

An Empirical Exploration in Quality Filtering of Text Data

Gao

End-to-End Differentiability and Tensor Processing Unit Computing to Accelerate Materials' Inverse Design

Liu et al.

Understanding Attention in Machine Reading Comprehension

Cui et al.

huggingface를 이용한 한국어 BART 학습 후기

Park

Making of #IAN

Kirchner

End-to-end Biomedical Question Answering via Bio-AnswerFinder and Discriminative Language Representation Models

Ozyurt

Large Biomedical Question Answering Models with ALBERT and ELECTRA

Alrowili & Vijay-Shanker

Pretrained Transformers for Text Ranking: BERT and Beyond

Lin, Nogueira & Yates

Understanding The Computational Demands Underlying Visual Reasoning

Vaishnav et al.

Using Computational Analysis of Behavior To Discover Developmental Change In Memory-Guided Attention Mechanisms In Childhood

Amso et al.

Vera: Prediction Techniques for Reducing Harmful Misinformation in Consumer Health Search

Pradeep et al.

gaBERT — an Irish Language Model

Barry et al.

Simple Allocation Rules and Optimal Portfolio Choice Over the Lifecycle

Duarte et al.

DiffIR: Exploring Differences in Ranking Models' Behavior

Jose et al.

Exploiting Generative Self-Supervised Learning For The Assessment Of Biological Images With Lack Of Annotations: A Covid-19 Case-Study

Mascolini et al.

ViTGAN: Training GANs with Vision Transformers

Lee et al.

Exploring Listwise Evidence Reasoning with T5 for Fact Verification

Jiang, Pradeep & Lin

Environment Classification for Robotic Leg Prostheses and Exoskeletons using Deep Convolutional Neural Networks

Laschowski et al.

Job Descriptions Keyword Extraction using Attention based Deep Learning Models with BERT

Mahdi et al.

Dangers of Bayesian Model Averaging under Covariate Shift

Izmailov et al.

LV-BERT: Exploiting Layer Variety for BERT

Yu et al.

Accessing your TPUs in Docker Containers with TPU VM

Nguyen

Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study

Khemchandani et al.

Training Data Augmentation for Code-Mixed Translation

Gupta, Vavre & Sarawagi

GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model

Wang & Komatsuzaki

Concurrent Adversarial Learning for Large-Batch Training

Liu et al.

PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World

Zellers et al.

Which transformer architecture fits my data? A vocabulary bottleneck in self-attention

Wies et al.

ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning

Yao et al.

Flexible Architectures for Image Synthesis

Jain

Scientific Claim Verification with VERT5ERINI

Pradeep et al.

Detecting Anatomical and Functional Connectivity Relations in Biomedical Literature via Language Representation Models

Ozyurt et al.

BioELECTRA:Pretrained Biomedical text Encoder using Discriminators

Kanakarajan, Kundumani & Sankarasubbu

Stress Test Evaluation of Biomedical Word Embeddings

Araujo et al.

Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level

Zhong et al.

How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering

Jiang et al.

CoolMomentum: a method for stochastic optimization by Langevin dynamics with simulated annealing

Borysenko & Byshkin

Tensorflow2 기반 Seq2Seq 모델, 학습, 서빙 코드 구현

Park

DeepDarts: Modeling Keypoints as Objects for Automatic Scorekeeping in Darts using a Single Camera

McNally et al.

KLUE: Korean Language Understanding Evaluation

Park et al.

How Deep is your Learning: the DL-HARD Annotated Deep Learning Dataset

Mackie, Dalton & Yates

Unbiased Monte Carlo Cluster Updates with Autoregressive Neural Networks

Wu et al.

Contextualized Query Embeddings for Conversational Search

Lin, Yang & Lin

DECIMER1.0: Deep Learning for Chemical Image Recognition using Transformers

Rajan, Zielesny & Steinbeck

Clinical BERT Models Trained on Pseudo Re-identified MIMIC-III Notes

Lehman et al.

Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model

Kummervold et al.

Categorising Vaccine Confidence with TransformerBased Machine Learning Model: The Nuances of Vaccine Sentiment on Twitter

Kummervold et al.

City-Scale Simulation Of Covid-19 Pandemic & Intervention Policies Using Agent-Based Modelling

Suryawanshi et al.

CodeTrans: Towards Cracking the Language of Silicone's Code Through Self-Supervised Deep Learning and High Performance Computing

Elnaggar et al.

Arabic Compact Language Modelling for Resource Limited Devices

Alyafeai & Ahmad

Igor Ivanov: Harnessing Machine Learning Skills to Reduce Damages from Tropical Storms

Radiant Earth Foundation

Computer Vision and Deep Learning for Environment-Adaptive Control of Robotic Lower-Limb Exoskeletons

Laschowski et al.

InAugment: Improving Classifiers via Internal Augmentation

Arar, Shamir & Bermano

IndT5: A Text-to-Text Transformer for 10 Indigenous Languages

Nagoudi et al.

Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languages

Ramesh et al.

Self-Supervised Representation Learning with Relative Predictive Coding

Tsai et al.

Virtual Sensing and Sensors Selection for Efficient Temperature Monitoring in Indoor Environments

Brunello et al.

Horizontally Fused Training Array: An Effective Hardware Utilization Squeezer for Training Novel Deep Learning Models

Wang et al.

Comparing score aggregation approaches for document retrieval with pretrained transformers

Zhang, Yates & Lin

MPII at the TREC 2020 Deep Learning Track

Li & Yates

The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models

Inoue et al.

Is Attention Better Than Matrix Decomposition?

Geng et al.

TPU Research Cloud — Free TPU Hardware for your Deep Learning Projects

Manai

TPUPoint: Automatic Characterization of Hardware-Accelerated Machine-Learning Behavior for Cloud Computing

Wudenhe & Tseng

UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark

Lourie et al.

Architext

Galanos

Score-Based Generative Modeling through Stochastic Differential Equations

Song et al.

I-BERT: Integer-only BERT Quantization

Kim et al.

A comprehensive fitness landscape model reveals the evolutionary history and future evolvability of eukaryotic cis-regulatory DNA sequences

Vaishnav et al.

ConvBERT: Improving BERT with Span-based Dynamic Convolution

Jiang et al.

Goal-Driven Recurrent Neural Network Models of the Ventral Visual Stream

Nayebi et al.

Introducing huBERT

Nemeskey

Symbolic regression for scientific discovery: an application to wind speed forecasting

Abdellaoui & Mehrkanoon

Text generation in GPT-2

a-emami

Time Series (re)sampling using Generative Adversarial Networks

Dahl & Sørensen

The Expando-Mono-Duo Design Pattern for Text Ranking with Pretrained Sequence-to-Sequence Models

Pradeep, Nogueira & Lin

Hessian-Aware Pruning and Optimal Neural Implant

Yu et al.

A Multi-Class Hinge Loss for Conditional GANs

Kavalerov, Czaja & Chellappa

Bottleneck Transformers for Visual Recognition

Srinivas et al.

Distributed Evolution Strategies Using TPUs for Meta-Learning

Sheng & He

Few-Shot Question Answering by Pretraining Span Selection

Ram et al.

Neural Grammatical Error Correction for Romanian

Cotet, Ruseti & Dascalu

Stress Testing of Meta-learning Approaches for Few-shot Learning

Aimen et al.

The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT

Pande et al.

Transfer Learning from Play and Language - Nailing the Baseline

Douglas

Addressing Machine Learning Concept Drift Reveals Declining Vaccine Sentiment During the COVID-19 Pandemic

Müller & Salathé

ARAELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding

Antoun, Baly & Hajj

AraGPT2: Pre-Trained Transformer for Arabic Language Generation

Antoun, Baly & Hajj

ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic

Abdul-Mageed, Elmadany & Nagoudi

PARSINLU:A Suite of Language Understanding Challenges for Persian

Khashabi et al.

RecipeNLG: A Cooking Recipes Dataset for Semi-Structured Text Generation

Bień et al.

STOUT: SMILES to IUPAC names using Neural Machine translation

Rajan, Zielesny & Steinbeck

The Depth-to-Width Interplay in Self-Attention

Levine et al.

Virtual Sensing of Temperatures in Indoor Environments: A Case Study

Brunello et al.

GottBERT: a pure German Language Model

Scheible et al.

HAWQ-V3: Dyadic Neural Network Quantization

Yao et al.

A Little Bit Is Worse Than None: Ranking with Limited Training Data

Zhang, Yates & Lin

An Empirical Study of Pre-trained Transformers for Arabic Information Extraction

Lan et al.

CLUE: A Chinese Language Understanding Evaluation Benchmark

Xu et al.

Cooking recipes generator utilizing a deep learning-based language model

Bień et al.

Ensemble Predictions of Wildfire Spread Through TPU-Compatible TensorFlow Acceleration

Bonanni & Ihme

Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks

Hui & Belkin

EvoPose2D: Pushing the Boundaries of 2D Human Pose Estimation using Neuroevolution

McNally et al.

Learning from Task Descriptions

Weller et al.

Modern Control Technologies in Robotics

ΠΑΝΑΓΙΩΤΗΣ & ΧΑΤΖΟΠΟΥΛΟ

On the weak link between importance and prunability of attention heads

Budhraja et al.

UoS Participation in the WMT20 Translation of Biomedical Abstracts

Soares & Vaz

Διπλωματική Εργασία Σχεδίαση Αποδοτικών Μηχανισμών Προσοχής Για Βαθειά Νευρωνικά Δίκτυα

Δάρας

An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks

Park et al.

Challenges in Zh-Ru MT Task and How to Overcome Them

Nazarov

Distilling Dense Representations for Ranking using Tightly-Coupled Teachers

Lin, Yang, Lin

Ensemble Predictions of Wildfire Spread Through TPU-Compatible TensorFlow Acceleration

Bonanni & Ihme

Flexible IR Pipelines with Capreolus

Yates et al.

German's Next Language Model

Chan, Schweter & Möller

Guiding Attention for Self-Supervised Learning with Transformers

Deshpande & Narasimhan

Identifying Learning Rules From Neural Network Observables

Nayebi et al.

LEGAL-BERT: The Muppets straight out of Law School

Chalkidis et al.

MammoGANesis: Controlled Generation of High-Resolution Mammograms for Radiology Education

Zakka et al.

ML Summit: Predict | Introduction to Swift for Tensorflow

Koonce

Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrastive Learning

Chang et al.

SMYRF: Efficient Attention using Asymmetric Clustering

Daras et al.

TPU VS GPU

Emami

WDN: A Wide and Deep Network to Divide-and-Conquer Image Super-resolution

Singh & Mittal

Plant Species Identification Using Transfer Learning-PlantCLEF 2020

Krishna, M & R

A Text to Text Approach for COVID-19 Event Extraction on Social Media

Wang

Application of Machine Learning Techniques for Text Generation

Román

Deep multi-stations weather forecasting: explainable recurrent convolutional neural networks

Abdellaoui & Mehrkanoon

Improving Dialog Evaluation with a Multi-reference Adversarial Dataset and Large Scale Pretraining

Sai et al.

IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages

Kakwani et al.

S3NAS: Fast NPU-aware Neural Architecture Search Methodology

Lee, Kang & Ha

Ethical Detection of Online Influence Campaigns Using Transformer Language Models

Crothers

GREEK-BERT: The Greeks visiting Sesame Street

Koutsikakis et al.

HASeparator: Hyperplane-Assisted Softmax

Kansizoglou et al.

PARADE: Passage Representation Aggregation for Document Reranking

Li et al.

PTT5: Pretraining and validating the T5 model on Brazilian Portuguese data

Carmo et al.

RECLOR: A Reading Comprehension Dataset Requiring Logical Reasoning

Yu et al.

A novel specific artificial intelligence-based method to identify COVID-19 cases using simple blood exams

Soares

Differentiable Augmentation for Data-Efficient GAN Training

Zhao et al.

Hong Kong Transformer Models And Other NLP Resources

出嚟食飯

Latent Retrieval for Large-Scale Fact-Checking and Question Answering with NLI training

Samarinas, Hsu & Lee

Lessons Learned from the Training of GANs on Artificial Datasets

Tang

Natural Language Processing Methods for Language Modeling

Nemeskey

NLP Reseach Project Part 2: How I (almost) replicated OpenAI's GPT-2 (124M version)

Khan

Playing with Words at the National Library of Sweden - Making a Swedish BERT

Malmsten, Borjeson & Haffenden

ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing

Elnaggar et al.

Tetra-Tagging: Word-Synchronous Parsing with Linear-Time Inference

Kitaev & Klein

This Pony Does Not Exist

Arfa

Denoising Diffusion Probabilistic Models

Ho, Jain & Abbeel

FinEst BERT and CroSloEngual BERT: less is more in multilingual models

Ulˇcar & Robnik-Sikonja

How the Google AI Community Used Cloud to Help Biomedical Researchers

Elliott, Kwon & Goncharov

Learning compact generalizable neural representations supporting perceptual grouping

Veerabadran & de Sa

On the Predictability of Pruning Across Scales

Rosenfeld et al.

Reproducible and Portable Workflows for Scientific Computing and HPC in the Cloud

Vaillancourt et al.

Swedish NLP Solutions for Email Classification

Castronuovo

Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers

Li et al.

ทุนวิจัย Tensorflow Research Cloud ที่ให้พวกเราสามารถใช้ TPU ได้ฟรี 60 วัน!

Chatpatanasiri

Adaptation of Deep Bidirectional Transformers for Afrikaans Language

Ralethe

COVID-Twitter-BERT: A Natural Language Processing Model To Analyse COVID-19 Content On Twitter

Müller, Salathé & Kummervold

CURL: Contrastive Unsupervised Representations for Reinforcement Learning

Srinivas, Laskin & Abbeel

Deep Learning Training at Scale: Experiments with MLPerf on Multi-GPU and Multi-TPU Hardware

Verma

Establishing Baselines for Text Classification in Low-Resource Languages

Cruz & Cheng

iMaterialist (Fashion) 2020 at FGVC7 - 1st place solution

Polosin

Lexicon-Enhancement of Embedding-based Approaches Towards the Detection of Abusive Language

Koufakou & Scott

ParaPat: The Multi-Million Sentences Parallel Corpus of Patents Abstracts

Soares et al.

ParsBERT: Transformer-based Model for Persian Language Understanding

Farahani et al.

Query Reformulation using Query History for Passage Retrieval in Conversational Search

Lin et al.

Successfully Applying the Stabilized Lottery Ticket Hypothesis to the Transformer Architecture

Brix, Bahar & Ney

This Fursona Does Not Exist

Arfa

TPU-Tutorial

Diao

A Deep Learning Algorithm For The Diagnosis And Gleason Grading Of Whole Slide Images Of Prostate Cancer Core Biopsies

Kott et al.

Imitation Attacks and Defenses for Black-box Machine Translation Systems

Wallace, Stern & Song

Playing with machines: Using machine learning to understand automated copyright enforcement at scale

Gray & Suzor

Revisiting Pre-Trained Models for Chinese Natural Language Processing

Cui et al.

TensorFlow TPU 학습 101

Hong

TPU를 이용하여 Electra Pretraining하기

Park

A Not-so-Dangerous AI in the Persian Language

Khashei

CLUECorpus2020: A Large-scale Chinese Corpus for Pre-training Language Model

Xu, Zhang & Dong

Comparing Rewinding and Fine-tuning in Neural Network Pruning

Renda, Frankle & Carbin

The Limitations of Stylometry for Detecting Machine-Generated Fake News

Schuster et al.

Writing Persian Poetry with GPT-2.0

Khashei

AraBERT: Transformer-based Model for Arabic Language Understanding

Antoun, Baly & Hajj

Discriminating between sleep and exercise-induced fatigue using computer vision and behavioral genetics

Schuch et al.

Going Much Wider with Deep Networks for Image Super-Resolution

Singh et al.

Improving the performance of convolutional neural network for the segmentation of optic disc in fundus images using attention gates and conditional random fields

Bhatkalkar et al.

Multi-focus Image Fusion Using Encoder-Decoder Network

Zhang

On Identifiability in Transformers

Brunner et al.

Redes neurais densamente conectadas para detecção de câncer de mama em imagens histopatológicas

Wentz

TensorFlow 2.1 with TPU in Practice

Lee

Two Routes to Scalable Credit Assignment without Weight Symmetry

Kunin et al.

Attention! A Lightweight 2D Hand Pose Estimation Approach

Santavas et al.

BERTje: A Dutch BERT Model

de Vries et al.

Cross-Lingual Ability of Multilingual BERT: An Empirical Study

K et al.

Discriminative Sentence Modeling for Story Ending Prediction

Cui et al.

The Selection of Optimal Neural Network Hyperparameters

Akhmetzyanov

Development of a Deep Learning Algorithm for the Histopathologic Diagnosis and Gleason Grading of Prostate Cancer Biopsies: A Pilot Study

Kott et al.

High-Quality Cloud Masking of Landsat 8 Imagery Using Convolutional Neural Networks

Hughes & Kennedy

Personalized Patent Claim Generation and Measurement

Lee

Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models

Daras et al.

Διαχείριση Πόρων σε Ετερογενείς Αρχιτεκτονικές με Εφαρμογή στο TensorFlow

Sofianídis

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Raffel et al.

Localization of Fake News Detection via Multitask Transfer Learning

Cruz, Tan & Cheng

My experience with Cloud TPU

Akhmetzyanov

Parallel Iterative Edit Models for Local Sequence Transduction

Awasthi et al.

Report of using TPU Pod to pre-train a Japanese NLP model

Cong

Solving an object detection problem with Google's TPUs

Palvelev

Unsupervised Question Answering for Fact-Checking

Jobanputra

Answering questions by learning to rank -- Learning to rank by answering questions

Pîrtoacă, Rebedea & Ruseti

Benchmarking the Performance and Power of AI Accelerators for AI Training

Wang et al.

Cross-Lingual Machine Reading Comprehension

Cui et al.

GPT-2 Folk Music

Branwen

Reweighted Proximal Pruning for Large-Scale Language Representation

Guo et al.

OpenGPT-2: We Replicated GPT-2 Because You Can Too

Gokaslan & Cohen

Running PyTorch on TPU: a bag of tricks

Chikishev

Towards Ethical Content-Based Detection of Online Influence Campaigns

Crothers, Japkowicz & Victor

Benchmarking TPU, GPU, and CPU Platforms for Deep Learning

Wang, Wei & Brooks

Exploring the Use of Lexicons to aid Deep Learning towards the Detection of Abusive Language

Koufakou & Scott

Single-Path Mobile AutoML: Efficient ConvNet Design and NAS Hyperparameter Optimization

Stamoulis et al.

Use What You Have: Video Retrieval Using Representations From Collaborative Experts

Liu et al.

A Focus on Neural Machine Translation for African Languages

Martinus & Abbott

Benchmarking Neural Machine Translation for Southern African Languages

Martinus & Abbott

Comic2vec: Vector representation of comics

Piták

Disentangling neural mechanisms for perceptual grouping

Kim et al.

Evaluating Language Model Finetuning Techniques for Low-resource Languages

Cruz & Cheng

Pre-Training with Whole Word Masking for Chinese BERT

Cui et al.

Replicating GPT2-1.5B

Leahy

Neural heuristics for SAT solving

Jaszczur et al.

Single-Path NAS: Device-Aware Efficient ConvNet Design

Stamoulis et al.

Fast Deep Neural Network Training on Distributed Systems and Cloud TPUs

You et al.

Single-Path NAS: Designing Hardware-Efficient ConvNets in less than 4 Hours

Stamoulis et al.

The Lottery Ticket Hypothesis at Scale

Frankle et al.

SCIBERT: Pretrained Contextualized Embeddings for Scientific Text

Beltagy, Cohan & Lo

Large-Batch Training for LSTM and Beyond

You et al.

ART + AI — Generating African Masks using Tensorflow and TPUs

Dibia

Ensemble, Distill, and Fuse for Easy Video Labeling

Zhou et al.

Google Cloud TPU を使用して気づいたことなど

Suzuki

Quaternion convolutional neural networks for detection and localization of 3D sound events

Comminiello et al.

End-to-end sound source separation conditioned on instrument labels

Slizovskaia et al.

Mapping scRNA-seq data onto cell type taxonomies

Svensson & Pachter

Sample-efficient image segmentation through recurrence

Linsley, Kim & Serre

Task-Driven Convolutional Recurrent Models of the Visual System

Nayebi et al.

Automatic full compilation of Julia programs and ML models to Cloud TPUs

Fischer & Saba

Dostałem 105 TPU! Grant od TensorFlow Research Cloud!

Majek

Conditional WaveGAN

Lee et al.

Inferring travel activity pattern from Smartphone sensing data using deep learning

Ghorpade

Learning what and where to attend

Linsley et al.

Maximum Entropy Fine-Grained Classification

Dubey et al.

Some tips about using Google's TPU

Dong

A tutorial on using Google Cloud TPUs

Lee