9j*ddlZddlmZddlZddlmZddlmZmZm Z m Z ddl m Z ddZ dZddZd Zej"d ed fd Zej"d ed fd Zej"d ed fdZy)N) Generator)global_decomposition_table) _rnn_helper gather_paramsgru_cell lstm_cell) while_loopc|d}|d|r|dnd}|r|dndt|dk(r|dnt|dk(r|dnd|djd}|djd}tjjj ||||rj dntjjdgt|jdd|j|jd} fd } fd } tjdtj } t| | | | ||g\} }}}|r|j d}||j!d|j!dffS) ay 1 layer fn for while loop LSTM Args: inp: Input tensor of shape (seq_len, batch, input_size) hidden: Tuple of (hx, cx) hidden states params: List of weight and bias tensors has_biases: Whether biases are included reverse: Whether to process sequence in reverse Returns: Tuple of (output, (final_hx, final_cx)) rNdtypedevicec,|jdkSNrsize)iouthxcxprecomputed_inputs U/media/conek/DATA/Code/OCR/venv/lib/python3.12/site-packages/torch/export/_patches.pycond_fnz*one_layer_while_loop_lstm..cond_fn.$))!,,,c *|j}tj|tj|jddz t |||d\}}|j }|j d||<|dz|||fS)Nrr maxr ) chunk_dim)itemtorch_check_is_sizerrclonesqueeze) idxrrrrhh_bias hh_weight hr_weightrs rbody_fnz*one_layer_while_loop_lstm..body_fn1s HHJ Q Q$5$:$:1$=$AB a "b)WiST BiikAAQwR##rr)len unsqueezer%nn functionallinearflipemptyrtupleshaperrtensorint64r r()inphiddenparams has_biasesreverse ih_weightih_biasrr step_outputrr-cnt_rfinal_hxfinal_cxr*r+r,rs @@@@rone_layer_while_loop_lstmrF sq Iq I%fQi4G%fQi4G[A%q F q8H6!9d   Q B   Q B++223 7K5<)..q1BS++q! rxx| hhyy K- $ ,,q ,C!+3 R4"AsHhhhqk !!!$h&6&6q&9: ::rc t|dk7r tdt|||djd|djdk7}t t |d|d} t } t|| |||||||| \} } t t | } | tj| ddtj| ddfS)a LSTM implementation using while_loop for export compatibility. This is a drop-in replacement for the default LSTM decomposition that uses while_loop instead of Python loops, making it more suitable for torch.export. Args: input: Input tensor hx: Tuple of (h0, c0) hidden states params: List of weight and bias tensors has_biases: Whether biases are included num_layers: Number of LSTM layers dropout: Dropout probability train: Training mode bidirectional: Whether to use bidirectional LSTM batch_first: Whether batch dimension is first Returns: Tuple of (output, h_n, c_n) r zlstm expects two hidden statesrr ) r/AssertionErrorrrlistziprFrr%stack inputrr<r= num_layersdropouttrain bidirectional batch_firstr;layer_fnr final_hiddenss rlstm_while_loop_implrUIs> 2w!|=>> 6:r!uzz!}1 1 /M NF #beRU# $F(H$   Cm,-M  M!,a0%++mA>NPQ2R RRrcf |d|d|r|dnd|r|dnd tjjj||rj dn|j d}tj jdgt|jdd|j|jd}fd} fd}tjdtj } t||| ||g\} } } |r| j d} | | jdfS) ad 1 layer fn for while loop GRU Args: inp: Input tensor of shape (seq_len, batch, input_size) hidden: Hidden state tensor params: List of weight and bias tensors has_biases: Whether biases are included reverse: Whether to process sequence in reverse Returns: Tuple of (output, final_hidden) rr r Nr rc,|jdkSrr)rr cur_hiddenrs rrz)one_layer_while_loop_gru..cond_fnrrc|j}tj|tj|jddz t ||}|j }|j d||<|dz||fS)Nrr r!)r$r%r&rrr'r() r)rrXrr*r+r@r?rs rr-z)one_layer_while_loop_gru..body_fns HHJ Q Q$5$:$:1$=$AB a *i)W iik##A&AQwZ''rr.)r%r1r2r3r4r0r5rr6r7rrr8r9r r()r:r;r<r=r>rXrArr-rBrCr final_hiddenr*r+r@r?rs @@@@@rone_layer_while_loop_grur[}s/q Iq I%fQi4G%fQi4G++223 7K5<)..q1BS!!!$J++q! z# $  K- ( ( ,,q ,C%gwk:8VWAsLhhqk  $$Q' ''rc t||d}t|jd} t} t || |||||||| \} } | t j | dfS)a GRU implementation using while_loop for export compatibility. This is a drop-in replacement for the default GRU decomposition that uses while_loop instead of Python loops, making it more suitable for torch.export. Args: input: Input tensor hx: Hidden state tensor params: List of weight and bias tensors has_biases: Whether biases are included num_layers: Number of GRU layers dropout: Dropout probability train: Training mode bidirectional: Whether to use bidirectional GRU batch_first: Whether batch dimension is first Returns: Tuple of (output, h_n) Fr)rrIunbindr[rr%rKrLs rgru_while_loop_implr^sn>6:u 5F "))A, F'H$   C  M1- --rreturn)NNNc#nKtd}|j|d}|jjtjj j d} |||<||jtjj j <d||||<n|j|d|2||jtjj j <y|jjtjj j dy#||||<n|j|d|2||jtjj j <w|jjtjj j dwxYww)a Generic context manager for registering while_loop-based RNN decompositions. Args: rnn_op: The aten operation to patch (e.g., torch.ops.aten.lstm.input) rnn_impl: The while_loop-based implementation function Note: This is an internal helper. Use register_lstm_while_loop_decomposition() or register_gru_while_loop_decomposition() instead. post_autogradN)rget py_kernelsr%_C DispatchKeyCompositeImplicitAutogradpop)rnn_oprnn_implregistryoriginal_decomporiginal_py_kernels r&_register_rnn_while_loop_decompositionrmsr*/:Hll640O **.. 66X#LT%((..HHI   &.HV  LL &  )"   ehh22LL M    ! !%(("6"6"P"PRV W  &.HV  LL &  )"   ehh22LL M    ! !%(("6"6"P"PRV Ws AF5:D$B F5$BF22F5c#Kttjjjj t 5ddddy#1swYyxYww)a Context manager that temporarily registers the while_loop-based LSTM decomposition. The while_loop-based decomposition is more suitable for export and graph-based execution, as it avoids Python control flow that cannot be captured in the graph. This should support dynamic sequence lengths, however as while_loop does not support Autograd yet, an ExportedProgram created with this will not be trainable. Usage:: from torch.export._patches import register_lstm_while_loop_decomposition from torch.export import export with register_lstm_while_loop_decomposition(): # Export your model with LSTM ep = export(model, (x, h0, c0)) Note: This context manager temporarily modifies the global decomposition table and py_kernels registration. The original registrations are restored when exiting the context. N)rmr%opsatenlstmrMrUrr®ister_lstm_while_loop_decompositionrssC0 0 !!#7  =AA  A AAc#Kttjjjj t 5ddddy#1swYyxYww)a Context manager that temporarily registers the while_loop-based GRU decomposition. The while_loop-based decomposition is more suitable for export and graph-based execution, as it avoids Python control flow that cannot be captured in the graph. This should support dynamic sequence lengths, however as while_loop does not support Autograd yet, an ExportedProgram created with this will not be trainable. Usage:: from torch.export._patches import register_gru_while_loop_decomposition from torch.export import export with register_gru_while_loop_decomposition(): # Export your model with GRU ep = export(model, (x, h0)) Note: This context manager temporarily modifies the global decomposition table and py_kernels registration. The original registrations are restored when exiting the context. N)rmr%rorpgrurMr^rrrr%register_gru_while_loop_decompositionrw2sC0 0   "5  rt)F) contextlibcollections.abcrr% torch._decomprtorch._decomp.decompositionsrrrr"torch._higher_order_ops.while_loopr rFrUr[r^contextmanagerrmrsrwrrrrr~s% 4XX9<;~1Sh3(l..b ,X ,X,X^  :J0K: y9I/Jr