3 packages found

ctranslate2

Fast inference engine for Transformer models
  1. opennmt
  2. nmt
  3. neural
  4. machine
  5. translation
  6. cuda
  7. mkl
  8. inference
  9. quantization
  10. avx
  11. avx2
  12. cpp
  13. deep-learning
  14. deep-neural-networks
  15. gemm
  16. intrinsics
  17. machine-translation
  18. neon
  19. neural-machine-translation
  20. onednn
  21. openmp
  22. parallel-computing
  23. thrust
  24. transformer-models
50 Contributors
4.6.0published 4 days agoMIT

deepsparse

An inference runtime offering GPU-class performance on CPUs and APIs to integrate ML into your application
  1. inference
  2. machine
  3. learning
  4. x86
  5. x86_64
  6. avx2
  7. avx512
  8. neural
  9. network
  10. sparse
  11. engine
  12. cpu
  13. runtime
  14. deepsparse
  15. computer
  16. vision
  17. object
  18. detection
  19. sparsity
  20. computer-vision
  21. cpus
  22. llm-inference
  23. machinelearning
  24. nlp
  25. object-detection
  26. onnx
  27. performance
  28. pretrained-models
  29. pruning
  30. quantization
  31. sparsification
40 Contributors
1.8.0published 9 months agoCDLA-Sharing-1.0

simsimd

Portable mixed-precision BLAS-like vector math library for x86 and ARM
  1. arm-neon
  2. arm-sve
  3. assembly
  4. avx2
  5. avx512
  6. bfloat16
  7. blas
  8. blas-libraries
  9. distance-calculation
  10. float16
  11. information-retrieval
  12. metrics
  13. neon
  14. numpy
  15. scipy
  16. simd
  17. simd-instructions
  18. similarity-measures
  19. similarity-search
  20. vector-search
32 Contributors
6.2.1published 4 months agoApache-2.0
Showing 1 to 3 of 3 results