9j&ddlZdgZeZdZeej drej jZdZGddeZy)N GreenContextF_CUDAGreenContextTc eZdZdZeddddddedzdedzdedzdedzdef d Zeddedzdefd Z dfd Z dfd Z dfd Z xZ S)rzyWrapper around a CUDA green context. .. warning:: This API is in beta and may change in future releases. Nnum_smsworkqueue_scopeworkqueue_concurrency_limit device_idrrr r returncVts tdtj||||S)a+Create a CUDA green context. At least one of ``num_sms`` or ``workqueue_scope`` must be specified. Both can be combined to partition SMs and configure workqueues in the same green context. Arguments: num_sms (int, optional): The number of SMs to use in the green context. When ``None``, SMs are not partitioned. workqueue_scope (str, optional): Workqueue sharing scope. One of ``"device_ctx"`` (shared across all contexts, default driver behaviour) or ``"balanced"`` (non-overlapping workqueues with other balanced green contexts). When ``None``, no workqueue configuration is applied. workqueue_concurrency_limit (int, optional): Maximum number of concurrent stream-ordered workloads for the workqueue. Requires ``workqueue_scope`` to be set. device_id (int, optional): The device index of green context. When ``None``, the current device is used. 1PyTorch was not built with Green Context support!)r rrr ) SUPPORTED RuntimeError _GreenContextcreaters Y/media/conek/DATA/Code/OCR/venv/lib/python3.12/site-packages/torch/cuda/green_contexts.pyrzGreenContext.creates78RS S##+(C $  cPts tdtj|S)awReturn the maximum workqueue concurrency limit for the device. This queries the device for the default number of concurrent stream-ordered workloads supported by workqueue configuration resources. Arguments: device_id (int, optional): The device index to query. When ``None``, the current device is used. r r )rrrmax_workqueue_concurrencyrs rrz&GreenContext.max_workqueue_concurrency>s'RS S666KKrc t|S)z+Make the green context the current context.)super set_contextself __class__s rrzGreenContext.set_contextPsw"$$rc t|S)zAssuming the green context is the current context, pop it from the context stack and restore the previous context. )r pop_contextrs rrzGreenContext.pop_contextTsw"$$rc t|S)z1Return the CUDA Stream used by the green context.)rStreamrs rr zGreenContext.StreamZsw~r)N)r N)r ztorch.cuda.Stream)__name__ __module__ __qualname____doc__ staticmethodintstrrrrrrr __classcell__)rs@rrrs #&*26 $ " t" t" &)4Z " : "  " " H LS4Z L3 L L"%%   r) torch__all__objectrrhasattr_Crrrrr/sQ     588()HH..MI J =J r