Instructions to use ivanfioravanti/FasterLivePortrait-MLX-weights with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ivanfioravanti/FasterLivePortrait-MLX-weights with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir FasterLivePortrait-MLX-weights ivanfioravanti/FasterLivePortrait-MLX-weights
- LivePortrait
How to use ivanfioravanti/FasterLivePortrait-MLX-weights with LivePortrait:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Upload FasterLivePortrait MLX runtime weights
Browse files- README.md +56 -0
- liveportrait_animal_mlx/base_models_v1.1/appearance_feature_extractor.npz +3 -0
- liveportrait_animal_mlx/base_models_v1.1/motion_extractor.npz +3 -0
- liveportrait_animal_mlx/base_models_v1.1/spade_generator.npz +3 -0
- liveportrait_animal_mlx/base_models_v1.1/warping_module.npz +3 -0
- liveportrait_mlx/appearance_feature_extractor.npz +3 -0
- liveportrait_mlx/landmark.npz +3 -0
- liveportrait_mlx/motion_extractor.npz +3 -0
- liveportrait_mlx/spade_generator.npz +3 -0
- liveportrait_mlx/stitching.npz +3 -0
- liveportrait_mlx/stitching_eye.npz +3 -0
- liveportrait_mlx/stitching_lip.npz +3 -0
- liveportrait_mlx/warping_module.npz +3 -0
README.md
ADDED
|
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- mlx
|
| 5 |
+
- liveportrait
|
| 6 |
+
- image-to-video
|
| 7 |
+
- apple-silicon
|
| 8 |
+
base_model:
|
| 9 |
+
- KlingTeam/LivePortrait
|
| 10 |
+
- warmshao/FasterLivePortrait
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# FasterLivePortrait MLX Weights
|
| 14 |
+
|
| 15 |
+
Converted MLX `.npz` runtime weights for
|
| 16 |
+
[FasterLivePortrait-MLX](https://github.com/ivanfioravanti/FasterLivePortrait-MLX).
|
| 17 |
+
|
| 18 |
+
These files are converted from permissively licensed LivePortrait /
|
| 19 |
+
FasterLivePortrait checkpoints:
|
| 20 |
+
|
| 21 |
+
- [KlingTeam/LivePortrait](https://huggingface.co/KlingTeam/LivePortrait), MIT
|
| 22 |
+
- [warmshao/FasterLivePortrait](https://huggingface.co/warmshao/FasterLivePortrait), MIT
|
| 23 |
+
|
| 24 |
+
## Included
|
| 25 |
+
|
| 26 |
+
- Human LivePortrait core MLX weights
|
| 27 |
+
- Human landmark MLX weights
|
| 28 |
+
- Human stitching / eye / lip retargeting MLX weights
|
| 29 |
+
- Animal LivePortrait v1.1 core MLX weights
|
| 30 |
+
|
| 31 |
+
## Not Included
|
| 32 |
+
|
| 33 |
+
This repository intentionally does **not** include XPose. XPose is used only for
|
| 34 |
+
animal landmark detection in FasterLivePortrait-MLX, and its upstream license is
|
| 35 |
+
restricted to non-commercial research use.
|
| 36 |
+
|
| 37 |
+
This repository also does not include the MediaPipe Face Landmarker task model;
|
| 38 |
+
download it from Google's MediaPipe model URL as documented in the project
|
| 39 |
+
README.
|
| 40 |
+
|
| 41 |
+
## Use
|
| 42 |
+
|
| 43 |
+
```bash
|
| 44 |
+
uv run python scripts/download_mlx_weights.py --repo-id ivanfioravanti/FasterLivePortrait-MLX-weights
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
+
## Conversion
|
| 48 |
+
|
| 49 |
+
The weights were produced with:
|
| 50 |
+
|
| 51 |
+
```bash
|
| 52 |
+
uv run --with onnx python scripts/export_mlx_weights.py --include-animal
|
| 53 |
+
```
|
| 54 |
+
|
| 55 |
+
Converted tensors are derivative model weights and inherit the obligations of
|
| 56 |
+
the original model licenses.
|
liveportrait_animal_mlx/base_models_v1.1/appearance_feature_extractor.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:54052779e4e2adbf3d0730be12860ab3085278a24d87dcba31b15337552b17a4
|
| 3 |
+
size 3377868
|
liveportrait_animal_mlx/base_models_v1.1/motion_extractor.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0b2d640483b34e1315be9cc7ae00f95827c7fb6fb9cfb016ba797fb6a9758191
|
| 3 |
+
size 112533394
|
liveportrait_animal_mlx/base_models_v1.1/spade_generator.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c04736ed8c7bd96533926afc33d94e6e4bf1f096c023ca76e1318a68871a6111
|
| 3 |
+
size 221503830
|
liveportrait_animal_mlx/base_models_v1.1/warping_module.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b8a93b92b98f230e6937a0d4b68669d8b6b0f2cc4b3f7275d72f4120e3a74863
|
| 3 |
+
size 182175112
|
liveportrait_mlx/appearance_feature_extractor.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4eec38855dce659872aa33b684dcb513289d905941a19531e7ff32bf464b4fbd
|
| 3 |
+
size 3377868
|
liveportrait_mlx/landmark.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c66103052111733619dfdb8dbb75073d190d696f4f9d80abd93bc340d5014815
|
| 3 |
+
size 114672178
|
liveportrait_mlx/motion_extractor.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f761c3441b3833af57603069bb5163b8355e28c0d5a9c64363f5e6d08def2178
|
| 3 |
+
size 112533394
|
liveportrait_mlx/spade_generator.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a9de6c00bff60ced8985429280a63c561cdf7d3cf8165edbdc0258643613f1b3
|
| 3 |
+
size 221503830
|
liveportrait_mlx/stitching.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c947d7dba4905d560bf144fb2ef9aa7dfb6fdab795736909073c8cc49a78501d
|
| 3 |
+
size 183098
|
liveportrait_mlx/stitching_eye.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72b5f6b00b43e4963f0ba24e9e58cdcb20a9332ac676480fdef4cf584124a750
|
| 3 |
+
size 581954
|
liveportrait_mlx/stitching_lip.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:af27dce745f662f4d7f48185e24bfc4caf33ebceb7e66f14c088f3844e8a53dd
|
| 3 |
+
size 151346
|
liveportrait_mlx/warping_module.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1e42984161e17391d41eec9b7444318890ff816cd23316e272707153bdf0d27d
|
| 3 |
+
size 182175112
|