vllm+syshax(CPU推理)
The sysHAX-adapter is primarily designed to enable inference frameworks and inference cards. It enhances the framework's functionality through module replacement. It also defines a unified operator interface for inference cards, accelerating the integration of large-scale hardware manufacturers with mainstream inference frameworks and reducing their development costs.
The sysHAX-adapter is primarily designed to enable inference frameworks and inference cards. It enhances the framework's functionality through module replacement. It also defines a unified operator interface for inference cards, accelerating the integration of large-scale hardware manufacturers with mainstream inference frameworks and reducing their development costs.
最近一年贡献:24 次
最长连续贡献:2 日
最近连续贡献:1 日
贡献度的统计数据包括代码提交、创建任务 / Pull Request、合并 Pull Request,其中代码提交的次数需本地配置的 git 邮箱是 Gitee 帐号已确认绑定的才会被统计。