Skip to content

cutery errors #5523

Description

@shaofengzeng

System Info / 系統信息

ubuntu 24.04
conda envs with python==3.10.20
pip install "xinference[all]"
errors:
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [85 lines of output]

  Error compiling Cython file:
  ------------------------------------------------------------
  ...
      def __init__(self, vocab: Dict[str, int], merges: List[Tuple[str, str]]):
          self._byte_encoder = bytes_to_unicode()
          self._byte_decoder = {v.decode("utf-8"): k for k, v in self._byte_encoder.items()}
          self._split_pattern = regex.compile(SPLIT_PATTERN)
          self._piece_to_id = vocab
          self._id_to_piece = {v: k for k, v in vocab.items()}
                                                           ^
  ------------------------------------------------------------
  cutlery/_bbpe.pyx:63:57: Compiler crash in OptimizeBuiltinCalls
  
  ModuleNode.body = StatListNode(_bbpe.pyx:3:0)
  StatListNode.stats[9] = StatListNode(_bbpe.pyx:50:0)
  StatListNode.stats[0] = CClassDefNode(_bbpe.pyx:50:0,
      as_name = 'ByteBPEProcessor',
      class_name = 'ByteBPEProcessor',
      module_name = '',
      punycode_class_name = 'ByteBPEProcessor',
      visibility = 'private')
  CClassDefNode.body = StatListNode(_bbpe.pyx:51:4)
  StatListNode.stats[0] = DefNode(_bbpe.pyx:58:4,
      modifiers = [...]/0,
      name = '__init__',
      node_positions = [...]/65,
      np_args_idx = [...]/0,
      num_required_args = 3,
      outer_attrs = [...]/2,
      py_wrapper_required = True,
      reqd_kw_flags_cname = '0',
      used = True)
  DefNode.body = StatListNode(_bbpe.pyx:59:8)
  StatListNode.stats[4] = SingleAssignmentNode(_bbpe.pyx:63:28)
  SingleAssignmentNode.rhs = ComprehensionNode(_bbpe.pyx:63:28,
      has_local_scope = True,
      is_temp = True,
      result_is_used = True,
      use_managed_ref = True)
  ComprehensionNode.loop = ForInStatNode(_bbpe.pyx:63:34)
  ForInStatNode.iterator = IteratorNode(_bbpe.pyx:63:46,
      is_temp = 1,
      result_is_used = True,
      use_managed_ref = True)
  IteratorNode.sequence = SimpleCallNode(_bbpe.pyx:63:57,
      analysed = True,
      is_temp = 1,
      result_is_used = True,
      use_managed_ref = True)
  
  Compiler crash traceback from this point on:
    File "Cython/Compiler/Visitor.py", line 174, in Cython.Compiler.Visitor.TreeVisitor._visit
    File "Cython/Compiler/Visitor.py", line 578, in Cython.Compiler.Visitor.MethodDispatcherTransform.visit_SimpleCallNode
    File "Cython/Compiler/Visitor.py", line 699, in Cython.Compiler.Visitor.MethodDispatcherTransform._dispatch_to_handler
  TypeError: 'NoneType' object is unsliceable
  Cythonizing sources
  Compiling cutlery/_spp.pyx because it changed.
  Compiling cutlery/_wordpiece.pyx because it changed.
  Compiling cutlery/_bbpe.pyx because it changed.
  [1/3] Cythonizing cutlery/_bbpe.pyx
  Traceback (most recent call last):
    File "/home/zsf/anaconda3/envs/xinfer/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
      main()
    File "/home/zsf/anaconda3/envs/xinfer/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
      json_out["return_val"] = hook(**hook_input["kwargs"])
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/zsf/anaconda3/envs/xinfer/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
      return hook(config_settings)
             ^^^^^^^^^^^^^^^^^^^^^
    File "/tmp/pip-build-env-3lcz9hys/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 333, in get_requires_for_build_wheel
      return self._get_build_requires(config_settings, requirements=[])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/tmp/pip-build-env-3lcz9hys/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
      self.run_setup()
    File "/tmp/pip-build-env-3lcz9hys/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
      exec(code, locals())  # noqa: S102 # exec is intentional here
      ^^^^^^^^^^^^^^^^^^^^
    File "<string>", line 210, in <module>
    File "<string>", line 197, in setup_package
    File "/tmp/pip-build-env-3lcz9hys/overlay/lib/python3.12/site-packages/Cython/Build/Dependencies.py", line 1153, in cythonize
      cythonize_one(*args)
    File "/tmp/pip-build-env-3lcz9hys/overlay/lib/python3.12/site-packages/Cython/Build/Dependencies.py", line 1264, in cythonize_one
      raise CompileError(None, pyx_file)
  Cython.Compiler.Errors.CompileError: cutlery/_bbpe.pyx
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed to build 'cutlery' when getting requirements to build wheel

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

latest

The command used to start Xinference / 用以启动 xinference 的命令

还未启动,安装出错

Reproduction / 复现过程

conda create -n xinfer python==3.10.20
pip install "xinference[all]"

Expected behavior / 期待表现

fix

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions