text: 
  
  TITLE
  Build docker images for tokenizers main branch
  
  COMMENTS
  1
  
  REACTIONS
  +1: 0
  -1: 0
  laugh: 0
  hooray: 0
  heart: 0
  rocket: 0
  eyes: 0
  
  BODY
  :warning: Do not merge this PR!
  
  PR 1/2: in order to run the full test suite (slow tests included), with the `main` branch of the `tokenizers` library, rebase this PR on `main`. Once the workflows have finished, head to PR 2/2 here: https://github.com/huggingface/transformers/pull/16712
  
  ---
  
  This PR is one of two items to run the full test suite for the tokenizers current `main` branch.
  
  In order to re-run, rebuild the docker images, publish them to the docker hub, and rebase this PR on the `main` branch of this repository.
  
  Steps done in order to create this PR:
  - Edit the dockerfiles so that they successfully install `tokenizers` from source in the container
  - Edit the `build-docker-images.yml` action to:
      - Have it push these images to the Docker Hub.
      - Remove all non important images
      - Edit the identifier to contain `internal` as a prefix, and `tokenizers-main` as a suffix.
  - Convert these images to private visibility so that it does not surprise users
  
  These images will be built on each commit, so rebasing this branch on `main` will retrigger the workflow