-
Running EchoMimicV2 on Windows 11
EchoMimicV2 is an opensource framework for audio driven human portrait animation. Compared to many other solutions (talking head) which only focusing on facial animation and head movement, this framework includes upper-body movement. The official repository tested the system on the Linux environment. However, this article records the process of running this framework on Windows 11…
-
Vision Transformers (ViT) Experiments Using PyTorch and PyTorch Lightning
Also can be seen at: https://medium.com/@heyulong3d/vision-transformers-vit-experiments-using-pytorch-and-pytorch-lightning-61e26738d9dd?sk=8326d1c2706380c7599c67e53d2e2b5c Overview This article will implement Vision Transformer (ViT) from scratch using PyTorch and PyTorch Lightning. It also covers insightful experiments with different patch size, model size, attention heads, and other improvements like overlapping patch embedding on CIFAR-10 dataset. This article will focus more on practice and experiments rather than…
-
[Deep Learning | ChatGPT]Learn Transformers(1) Tensors: It’s All About APIs!
Environment: TensorFlow Code Error happened.
-
[Deep Learning | ChatGPT]Learn Transformers(0) Let’s Do Some Research!
I have not done much deep learning research for about one year, because I have focused on development development and deep learning model deployment in Unreal 5. These days, ChatGPT have gained much popularity in our world, and we do have some technical need to learn text-based interface of human-computer interaction. I have done deep…
-
[Deep Learning]ONNX Runtime C++(2): Inferencing ONNX Model of Dynamic Input/Output Size Using CUDA
Some ONNX models have dynamic input/output size: In the above example, onnxruntime will set dimensions of batch_size, height, width to -1. NOTE: I tested it on onnxruntime v1.13.1 and onnxruntime-win-x64-gpu-1.13.1.zip. Some tips to avoid runtime errors(these errors often happen, and waste me a lot of time😱): We should Specify its shape when creating input tensors,…
-
[Deep Learning]ONNX Runtime C++(1):DL Model Inference Using ONNX Runtime
![[Deep Learning]ONNX Runtime C++(1):DL Model Inference Using ONNX Runtime](https://hyl3d.com/wp-content/uploads/2022/12/FnsCandyStyleTransfer.png)
Example: FnsCandyStyleTransfer This example is based on microsoft/onnxruntime-inference-examples. I use Windows x64 platform, so LibPNG is a dependency: Compile and use libpng and zlib in Visual Studio References Error happened.
