#
� GLSL.std.450 main . � � � | � �
GL_GOOGLE_cpp_style_line_directive GL_GOOGLE_include_directive main token_idx gl_WorkGroupID head_idx tid gl_LocalInvocationID slot SM slot_mapping * block_idx , Pc , key_stride , value_stride , num_kv_heads , head_size , block_size . 4 block_off 9 hs4 ? wpt B head_stride G block_stride M dst_base Y k_src c v_src p lmax r d K key � � s_red � s � amax � inv � w � word � l � q � KC � key_cache �
d V value ) s N w X word Y l a q z VC z value_cache | G G G H H # G G " G ! H , # H , # H , # H , # H , # G , G ~ H H # G G � " G � ! G � H � # G � G � " G � ! G H H # G G " G ! G y H z # G z G | " G | ! G � !
;
+
+ ;
; + + $ ���� % , - , ; - . + / 0 + : + = + H + e n o n + n q ~ n ~ � ; � � � n + � � � n � � � ; � � � n + � + � + � @ + n � �B � + � ����+ � + � � + � � � � � � ; � � + n �? n ; y z y { z ; { | , � � 6 � ; ; ; ; ; * ; 4 ; 9 ; ? ; B ; G ; M ; Y ; c ; o p ; r ; � ; o � ; o � ; o � ; � ; � ; � ; � � ; o ;
; ) ; o G ; N ; X ; Y ; � a ; o � A
= > A
= > A
= > = A ! = " ! > " = # � % & # $ � ( � & ' ( � ' � � ( = + A 0 1 . / = 2 1 � 3 + 2 > * 3 = 5 A 0 6 . / = 7 6 � 8 5 7 > 4 8 A 0 ; . : = < ; � > < = > 9 > = @ 9 � A @ > ? A A 0 C . / = D C = E ? � F D E > B F A 0 I . H = J I = K B � L J K > G L = N * = O G � P N O = Q = R B � S Q R � T P S = U 4 = V ? � W U V � X T W > M X = Z A 0 [ . = \ [ � ] Z \ = ^ A 0 _ . : = ` _ � a ^ ` � b ] a > Y b = d A 0 f . e = g f � h d g = i A 0 j . : = k j � l i k � m h l > c m > p q = s > r s � t � t � v w � x � x = y r A 0 z . : = { z � % | y { � | u v � u = n } p = � Y = � r � � � � A � � � � = n � � n � � n � ( } � > p � � w � w = � r � � � � > r � � t � v = � = n � p A � � � � > � � � � � � > � � � � � � � � � � � � � = � � � % � � � � � � � � = � = � � � % � � � � � � � � � � � = � = � A � � � � = n � � = � = � � � � � � A � � � � = n � � n � ( � � A � � � � > � � � � � � � � � � � � � � = � � � � � e > � � � � � � A � � � = n � � > � � = n � � � % � � q � � � � � � � � = n � � � n � � � > � � � � � � > � q � � � � = n � � > � � = � > � � � � � � � � � � � � � = � � = � 9 � % � � � � � � � � � > � > � � � � � � � � � � � � = � � � % � � = � � � � � � = � Y = � � � � � = � � � � = � � � � � � A � � � � = n � � = n � � � n � � � n � � n � � � - � � � > � � = � � | � � � � � � = � � � � � � � � � � = � � � � � � > � � � � � � = � � � � � e > � � � � � � = � M = � � � � � � = � � A � � � > � � � � � � = � � � � � � > � � � � � � = � � % � � � � � � � � � � = � M = � 9 � � � = n � � % q � � � = n � � n � > � � > � � = n
|
A � > � � � � � � � � > p q = >
� � � � � =
A 0 . : = � % � � = n p = c =
� A � = n ! n " ! n # ( " > p # � � = $
� % $ � >
% � � = & = n ' p A � ( � & > ( ' � � � � > ) � � * � * � , - � . � . = / ) � % 0 / � 0 + , � + = 1 = 2 ) � % 3 1 2 � 5 � 3 4 5 � 4 = 6 = 7 A � 8 � 7 = n 9 8 = : = ; ) � < : ; A � = � < = n > = n ? ( 9 > A � @ � 6 > @ ? � 5 � 5 � � � � � - � - = A ) � B A e > ) B � * � , A � C � = n D C > � D = n E � � % F E q � I � F H L � H = n J � � n K � J > G K � I � L > G q � I � I = n M G > � M = O > N O � P � P � R S � T � T = U N = V 9 � % W U V � W Q R � Q > X > Y � Z � Z � \ ] � ^ � ^ = _ Y � % ` _ = � ` [ \ � [ = b c = c N � d c = � e b d = f Y � g e f A � h g = n i h = n j � � n k i j n l k n m l n - m � � > a n = o a | p o � q p � = r Y � s r � � t q s = u X � v u t > X v � ] � ] = w Y � x w e > Y x � Z � \ = } M = ~ N � } ~ = � X A � | > � � � S � S = � N � � � � > N � � P � R = � � % � � � � � � � � � � = � M = � 9 � � � � = n � � � % � � q � � � � � � � � = n � � � n � � � > � � � � � � > � � � � � = n � � | � � A � | � > � � � � � � � 8