Skip to content
Projects

thepowerfuldeez/facemesh.pytorch has 304 GitHub stars and 64 forks. GitHot measured 0 stars in 24 hours. Last checked 2026-11-21 06:56 UTC. Last push 2020-06-12.

How these counts are measured

Measured star growth

in 24h
0
in 7 days
Collecting history
in 15 days
Collecting history
in 1 month
Collecting history

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

About

This is the PyTorch implementation of paper Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs (https://arxiv.org/pdf/1907.06724.pdf)

Machine Learning

README.md

Original

This is the PyTorch implementation of paper Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs (https://arxiv.org/pdf/1907.06724.pdf)

This version doesn't have BatchNorm layers for fine-tuning. If you want to use such model for training, you should add these layers manually.

The procedure for conversion was pretty interesting:

  1. I unpacked ARCore iOS framework and took tflite model of facemesh. You can download it here
  2. Paper doesn't state any architecture details, so I looked at Netron graph visualization to reverse-engineer number of input-output channels and operations.
  3. Made them in pytorch and transfer raw weights from tflite file semi-manually into pytorch model definition. (see Convert-FaceMesh.ipynb for details)

Input for the model is expected to be cropped face with 25% margin at every side, resized to 192x192 and normalized from -1 to 1

However, predict_on_image function normalizes your image itself, so you can even treat resized image as np.array as input

See Inference-FaceMesh.ipynb notebook for usage example