Browse » Gaming

Gaming

Open source gaming computer vision datasets, pre-trained models, and APIs.

Double twelve dominoes

Double twelve dominoes detection

Overview

Made as a side-project after my friends and I started getting into playing Mexican Train Dominoes. This is the data set used for the model applied on a website I made to keep track of my score at the end of each round.

https://pip-tracker.netlify.app/

Pip Tracker

About me

I'm a Software Engineer working for Google at the intersection between News and Search. I mostly work on Web projects but have tinkered in embedded apps, games, automation, and (most recently) ML over the years.

https://twitter.com/ricky_hartmann
https://github.com/hartmannr76

CSGO TRAIN YOLO V5

CSGO AIMBOT

Go Win

Trained on 5.9k Images

Draughts Board

This dataset was created by Harry Field and contains the labelled images for capturing the game state of a draughts/checkers 8x8 board.

This was a fun project to develop a mobile draughts applciation enabling users to interact with draughts-based software via their mobile device's camera.

The data captured consists of:

  • White Pieces
  • White Kings
  • Black Pieces
  • Black Kings
  • Bottom left corner square
  • Top left corner square
  • Top right corner square
  • Bottom right corner square

Corner squares are captured so the board locations of the detected pieces can be estimated.

Results of Yolov5 model after training with this dataset

From this data, the locations of other squares can be estimated and game state can be captured. The image below shows the data of a different board configuration being captured. Blue circles refer to squares, numbers refer to square index and the coloured circles refer to pieces.

Once game state is captured, integration with other software becomes possible. In this example, I created a simple move suggestion mobile applciation seen working here.

The developed application is a proof of concept and is not available to the public. Further development is required in training the model accross multiple draughts boards and implementing features to add vlaue to the physical draughts game.

The dataset consists of 759 images and was trained using Yolov5 with a 70/20/10 split.

The output of Yolov5 was parsed and filtered to correct for duplicated/overlapping detections before game state could be determined.

I hope you find this dataset useful and if you have any questions feel free to drop me a message on LinkedIn as per the link above.

Chess Pieces

Overview

This is a dataset of Chess board photos and various pieces. All photos were captured from a constant angle, a tripod to the left of the board. The bounding boxes of all pieces are annotated as follows: white-king, white-queen, white-bishop, white-knight, white-rook, white-pawn, black-king, black-queen, black-bishop, black-knight, black-rook, black-pawn. There are 2894 labels across 292 images.

Chess Example

Follow this tutorial to see an example of training an object detection model using this dataset or jump straight to the Colab notebook.

Use Cases

At Roboflow, we built a chess piece object detection model using this dataset.

ChessBoss

You can see a video demo of that here. (We did struggle with pieces that were occluded, i.e. the state of the board at the very beginning of a game has many pieces obscured - let us know how your results fare!)

Using this Dataset

We're releasing the data free on a public license.

About Roboflow

Roboflow makes managing, preprocessing, augmenting, and versioning datasets for computer vision seamless.

Developers reduce 50% of their boilerplate code when using Roboflow's workflow, save training time, and increase model reproducibility.

Roboflow Workmark

halo infinite angel aim

Halo Infinite: Spartan Dataset

Classifications

There are four classifications:

  1. Enemy
  2. Enemy Head
  3. Friendly
  4. Friendly Head

Image Settings

Images are 320p by 320p centered on the targeting reticule

Game Settings

Images were gathered on low settings. Enemies are color:pineapple and allies are default blue.

Attribution and License

This dataset was created and annotated by Graham Doerksen and is available under CC BY 4.0 license

The Dreidel Project

  • Salo Levy
  • Hebrew-Letters Dataset
  • 575 images

When learning to play Dreidel, I would sometimes forget what the names of each character are and what action they correspond to in the game. I thought it’d be fun to create a computer vision model that could understand what each symbol on a Dreidel is, making it easier to learn to play the game.

This model tracks the dreidel as it spins and detects the letters that are on the four sided dreidel.

How to Play Dreidel

Rules:
1. The players are dealt gelt (chocolate wrapped in gold paper made to look like a coin)
2. Each player takes a turn at spinning the Dreidel
3. The Dreidel has four sides that each prompt an action to take by the spinner
If נ‎ (nun) is facing up, the player does nothing.
If ג‎ (gimel) is facing up, the player gets everything in the pot.
If ה‎ (hay) is facing up, the player gets half of the pieces in the pool.
If ש‎ (shin) the player adds one of their gelt to the pot
4. The winner, of course, gets to eat all the gelt

Hopefully, with this application, one can create an application that teaches someone how to play dreidel.

Billiard_POOL

Valorant Smokes and Flashes

Real life Valorant Gameplay Expirience

This Dataset was used to create an AI for Valorant that would Smoke and Flash me In Real Life.

Full Video: https://youtu.be/aopXw22iL1M

Clash of Clans

Background Information

This dataset was curated and annotated by Find This Base. A custom dataset composed of 16 classes from the popular mobile game, Clash of Clans.

  • Classes: Canon, WizzTower, Xbow, AD, Mortar, Inferno, Scattershot, AirSweeper, BombTower, ClanCastle, Eagle, KingPad, QueenPad, RcPad, TH13 and WardenPad.

Find This Base

How to Use Find This Base
How to Use Find This Base

The original custom dataset (v1) is composed of 125 annotated images.

The dataset is available under the CC BY 4.0 license.

Getting Started

You can download this dataset for use within your own projects, or fork it into a workspace on Roboflow to create your own model.

Dataset Versions

Version 1 (v1) - 125 images

  • Preprocessing - Auto-Orient and Resize: Fit (black edges) to 640x640
  • Augmentations - No augmentations applied
  • Training Metrics - Trained from Scratch (no checkpoint used) on Roboflow
    • mAP = 83.1%, precision = 43.0%, recall = 99.1%

Version 4 (v4) - 301 images

  • Preprocessing - Auto-Orient and Resize: Fit (black edges) to 640x640
  • Augmentations - Mosaic
  • Generated Images - Outputs per training example: 3
  • Training Metrics - Trained from Scratch (no checkpoint used) on Roboflow
    • mAP = %, precision = %, recall = %

Find This Base: Official Website | How to Use Find This Base | Discord | Patreon

yoloapex

Apex Enemy Detection

Use this PRE-TRAINED MODEL to create an aimbot and identify enemies

Use your webcam to infer, or use the hosted inference API

More deployment options are available

Uno Cards

Overview

This dataset contains 8,992 images of Uno cards and 26,976 labeled examples on various textured backgrounds.

This dataset was collected, processed, and released by Roboflow user Adam Crawshaw, released with a modified MIT license: https://firstdonoharm.dev/

Image example

Use Cases

Adam used this dataset to create an auto-scoring Uno application:

Getting Started

Fork or download this dataset and follow our How to train state of the art object detector YOLOv4 for more.

Annotation Guide

See here for how to use the CVAT annotation tool.

About Roboflow

Roboflow makes managing, preprocessing, augmenting, and versioning datasets for computer vision seamless.
:fa-spacer:
Developers reduce 50% of their boilerplate code when using Roboflow's workflow, save training time, and increase model reproducibility.
:fa-spacer:

Roboflow Wordmark

Playing Cards

Overview

The Playing Cards dataset is a collection of synthetically generated cards blended into various types of backgrounds. You will be able to perform object detection to detect both number and suit of the cards.

Example Footage

Training and Deployment

The playing cards model has been trained in Roboflow, available for inference on the Dataset tab.

One could also build a Card Counting model for either Black Jack or Poker using YOLOR. This is achieved using the Roboflow Platform which you can deploy the model for robust and real-time detections. You can learn more here: https://augmentedstartups.info/YOLOR-Get-Started

Video Demo using YOLOR for training- https://youtu.be/2lGTZuaH4ec

About Augmented Startups

We are at the forefront of Artificial Intelligence in computer vision. With over 90k subscribers on YouTube, we embark on fun and innovative projects in this field and create videos and courses so that everyone can be an expert in this field. Our vision is to create a world full of inventors that can turn their dreams into reality.

valorant-object-detection2

Valorant Head/Body Aimbot

This trained model uses our dataset that focuses on annotating head and body of enemies in valorant.

Boggle Boards

Overview

We have captured and annotated photos of the popular board game, Boggle. Images are predominantly from 4x4 Boggle with about 30 images from Big Boggle (5x5).

  • 357 images
  • 7110 annotated letter cubes

These images are released for you to use in training your machine learning models.

Use Cases

We used this dataset to create BoardBoss, an augmented reality board game helper app. You can download BoardBoss in the App Store for free to see the end result!
:fa-spacer:
BoardBoss
:fa-spacer:
The model trained from this dataset was paired with some heuristics to recreate the board state and overlay it with an AR representation. We then used a traditional recursive backtracking algorithm to find and show the best words on the board.

Using this Dataset

We're releasing the data as public domain. Feel free to use it for any purpose.
It's not required to provide attribution, but it'd be nice! :fal-smile-wink:

About Roboflow

Roboflow makes managing, preprocessing, augmenting, and versioning datasets for computer vision seamless.

Developers reduce 50% of their boilerplate code when using Roboflow's workflow, save training time, and increase model reproducibility.
:fa-spacer:

Roboflow Workmark

Dice

Overview

We have captured and annotated photos of six-sided dice. There are 359 total images from a few sets:

  • 154 single dice of various styles on a white table
  • 388 Catan Dice (Red and Yellow, some rolled on a white table, 160 on top of or near the Catan board)
  • 13 mass groupings of dice in various styles

These images are released for you to use in training your machine learning models.
:fa-spacer:
Example Image
:fa-spacer:
Classes are generally balanced. Here's the output of Roboflow's Dataset Health check:
Class Balance

Use Cases

This would be a great dataset to test out different object detection models like YOLO v3, MaskRCNN, mobilenet, or others.

You could use it to create dice game helper apps (like a dice counter) or independent games.

Using this Dataset

We're releasing the data as public domain. Feel free to use it for any purpose.
It's not required to provide attribution, but it'd be nice! :fal-smile-wink:

About Roboflow

Roboflow makes managing, preprocessing, augmenting, and versioning datasets for computer vision seamless.

Developers reduce 50% of their boilerplate code when using Roboflow's workflow, save training time, and increase model reproducibility.
:fa-spacer:

Roboflow Wordmark