{"category": "unknown", "token_len": 111, "text": "In the vast expanse of human knowledge and experience, there exists a profound interconnectedness that weaves through the fabric of our existence, binding together the threads of history, culture, science, and philosophy into a magnificent tapestry that tells the story of our collective journey through time and space. From the earliest civilizations that emerged along the banks of great rivers to the modern metropolises that stretch skyward with their gleaming towers of glass and steel, humanity has demonstrated an remarkable capacity for innovation, creativity, and adaptation in the face of countless challenges and opportunities."}
{"category": "unknown", "token_len": 10, "text": "The quick brown fox jumps over the lazy dog."}
{"category": "unknown", "token_len": 48, "text": "In the heart of the bustling city, where skyscrapers touched the clouds and streets hummed with endless activity, there lived a small community of artists who found inspiration in the chaos around them, creating masterpieces that captured the essence of urban life."}
{"category": "unknown", "token_len": 3, "text": "Привет!"}
{"category": "unknown", "token_len": 20, "text": "Быстрая коричневая лиса прыгает через ленивую собаку."}
{"category": "unknown", "token_len": 67, "text": "В самом сердце шумного города, где небоскрёбы касались облаков, а улицы гудели от бесконечной активности, жила небольшая община художников, которые находили вдохновение в окружающем их хаосе, создавая шедевры, отражающие суть городской жизни."}
{"category": "unknown", "token_len": 2, "text": "Hallo!"}
{"category": "unknown", "token_len": 14, "text": "Der schnelle braune Fuchs springt über den faulen Hund."}
{"category": "unknown", "token_len": 66, "text": "Im Herzen der geschäftigen Stadt, wo Wolkenkratzer die Wolken berührten und die Straßen von endloser Aktivität summten, lebte eine kleine Gemeinschaft von Künstlern, die Inspiration im Chaos um sie herum fanden und Meisterwerke schufen, die die Essenz des städtischen Lebens einfingen."}
{"category": "unknown", "token_len": 2, "text": "你好！"}
{"category": "unknown", "token_len": 14, "text": "敏捷的棕色狐狸跳过了懒狗。"}
{"category": "unknown", "token_len": 65, "text": "在繁华都市的中心，摩天大楼触及云端，街道上充满了无尽的活动声，一个小小的艺术家社区在这里生活着，他们在周围的混乱中找到灵感，创作出捕捉都市生活精髓的杰作。"}
{"category": "unknown", "token_len": 2, "text": "Bonjour!"}
{"category": "unknown", "token_len": 14, "text": "Le renard brun rapide saute par-dessus le chien paresseux."}
{"category": "unknown", "token_len": 76, "text": "Au cœur de la ville animée, où les gratte-ciel touchaient les nuages et où les rues bourdonnaient d'une activité sans fin, vivait une petite communauté d'artistes qui trouvaient l'inspiration dans le chaos qui les entourait, créant des chefs-d'œuvre qui capturaient l'essence de la vie urbaine."}
{"category": "unknown", "token_len": 3, "text": "¡Hola!"}
{"category": "unknown", "token_len": 15, "text": "El rápido zorro marrón salta sobre el perro perezoso."}
{"category": "unknown", "token_len": 67, "text": "En el corazón de la bulliciosa ciudad, donde los rascacielos tocaban las nubes y las calles zumbaban con actividad interminable, vivía una pequeña comunidad de artistas que encontraban inspiración en el caos que los rodeaba, creando obras maestras que capturaban la esencia de la vida urbana."}
{"category": "unknown", "token_len": 3, "text": "Ciao!"}
{"category": "unknown", "token_len": 15, "text": "La volpe marrone veloce salta sopra il cane pigro."}
{"category": "unknown", "token_len": 72, "text": "Nel cuore della città frenetica, dove i grattacieli toccavano le nuvole e le strade ronzavano di attività senza fine, viveva una piccola comunità di artisti che trovavano ispirazione nel caos che li circondava, creando capolavori che catturavano l'essenza della vita urbana."}
{"category": "unknown", "token_len": 2, "text": "Hallo!"}
{"category": "unknown", "token_len": 13, "text": "De snelle bruine vos springt over de luie hond."}
{"category": "unknown", "token_len": 66, "text": "In het hart van de bruisende stad, waar wolkenkrabbers de wolken raakten en de straten gonsden van eindeloze activiteit, woonde een kleine gemeenschap van kunstenaars die inspiratie vonden in de chaos om hen heen, en meesterwerken creëerden die de essentie van het stadsleven vastlegden."}
{"category": "unknown", "token_len": 4, "text": "Xin chào!"}
{"category": "unknown", "token_len": 15, "text": "Con cáo nâu nhanh nhẹn nhảy qua con chó lười."}
{"category": "unknown", "token_len": 83, "text": "Ở trung tâm thành phố nhộn nhịp, nơi những tòa nhà chọc trời chạm tới mây và đường phố ồn ào với hoạt động không ngừng nghỉ, có một cộng đồng nhỏ các nghệ sĩ sống, họ tìm thấy cảm hứng trong sự hỗn loạn xung quanh, tạo ra những kiệt tác nắm bắt được bản chất của cuộc sống đô thị."}
{"category": "unknown", "token_len": 2, "text": "Halo!"}
{"category": "unknown", "token_len": 14, "text": "Rubah coklat yang cepat melompati anjing yang malas."}
{"category": "unknown", "token_len": 68, "text": "Di jantung kota yang ramai, di mana gedung pencakar langit menyentuh awan dan jalanan dipenuhi dengan aktivitas tanpa henti, tinggallah sebuah komunitas kecil seniman yang menemukan inspirasi dalam kekacauan di sekitar mereka, menciptakan karya agung yang menangkap esensi kehidupan perkotaan."}
{"category": "unknown", "token_len": 3, "text": "مرحبا!"}
{"category": "unknown", "token_len": 16, "text": "الثعلب البني السريع يقفز فوق الكلب الكسول."}
{"category": "unknown", "token_len": 65, "text": "في قلب المدينة الصاخبة، حيث تلامس ناطحات السحاب الغيوم وتطن الشوارع بنشاط لا ينتهي، عاش مجتمع صغير من الفنانين الذين وجدوا الإلهام في الفوضى المحيطة بهم، وخلقوا روائع تلتقط جوهر الحياة الحضرية."}
{"category": "unknown", "token_len": 3, "text": "Szia!"}
{"category": "unknown", "token_len": 16, "text": "A gyors barna róka átugrik a lusta kutya felett."}
{"category": "unknown", "token_len": 97, "text": "A nyüzsgő város szívében, ahol a felhőkarcolók az egekig értek és az utcák végtelen aktivitástól zümmögtek, élt egy kis művészközösség, akik a körülöttük lévő káoszban találtak inspirációt, remekműveket alkotva, amelyek megragadták a városi élet lényegét."}
{"category": "unknown", "token_len": 2, "text": "Salut!"}
{"category": "unknown", "token_len": 15, "text": "Vulpea brună rapidă sare peste câinele leneș."}
{"category": "unknown", "token_len": 82, "text": "În inima orașului aglomerat, unde zgârie-norii atingeau norii și străzile zumzăiau de activitate nesfârșită, trăia o mică comunitate de artiști care găseau inspirație în haosul din jurul lor, creând capodopere care capturau esența vieții urbane."}
{"category": "unknown", "token_len": 2, "text": "Hej!"}
{"category": "unknown", "token_len": 15, "text": "Den hurtige brune ræv springer over den dovne hund."}
{"category": "unknown", "token_len": 71, "text": "I hjertet af den travle by, hvor skyskraberne rørte skyerne og gaderne summede af uendelig aktivitet, boede et lille fællesskab af kunstnere, som fandt inspiration i kaosset omkring dem og skabte mesterværker, der fangede essensen af bylivet."}
{"category": "unknown", "token_len": 4, "text": "Ahoj!"}
{"category": "unknown", "token_len": 17, "text": "Rýchla hnedá líška skáče cez lenivého psa."}
{"category": "unknown", "token_len": 85, "text": "V srdci rušného mesta, kde mrakodrapy siahali až k oblakom a ulice bzučali nekonečnou aktivitou, žila malá komunita umelcov, ktorí nachádzali inšpiráciu v chaose okolo seba a vytvarali majstrovské diela zachytávajúce podstatu mestského života."}
{"category": "unknown", "token_len": 4, "text": "Привіт!"}
{"category": "unknown", "token_len": 22, "text": "Швидка коричнева лисиця стрибає через ледачого пса."}
{"category": "unknown", "token_len": 85, "text": "У самому серці галасливого міста, де хмарочоси торкалися хмар, а вулиці гуділи від нескінченної активності, жила невелика спільнота митців, які знаходили натхнення в навколишньому хаосі, створюючи шедеври, що відображали суть міського життя."}
{"category": "unknown", "token_len": 2, "text": "Hola!"}
{"category": "unknown", "token_len": 18, "text": "La guineu marró ràpida salta sobre el gos mandrós."}
{"category": "unknown", "token_len": 74, "text": "Al cor de la ciutat bulliciosa, on els gratacels tocaven els núvols i els carrers brunzien amb activitat interminable, vivia una petita comunitat d'artistes que trobaven inspiració en el caos que els envoltava, creant obres mestres que capturaven l'essència de la vida urbana."}
{"category": "unknown", "token_len": 4, "text": "Здраво!"}
{"category": "unknown", "token_len": 14, "text": "Brza smeđa lisica skače preko lenjog psa."}
{"category": "unknown", "token_len": 79, "text": "У срцу ужурбаног града, где су облакодери додиривали облаке а улице зујале од бескрајне активности, живела је мала заједница уметника који су проналазили инспирацију у хаосу око себе, стварајући ремек-дела која су хватала суштину урбаног живота."}
{"category": "unknown", "token_len": 3, "text": "Bok!"}
{"category": "unknown", "token_len": 14, "text": "Brza smeđa lisica skače preko lijenog psa."}
{"category": "unknown", "token_len": 67, "text": "U srcu užurbanog grada, gdje su neboderi dodirivali oblake a ulice zujale od beskrajne aktivnosti, živjela je mala zajednica umjetnika koji su pronalazili inspiraciju u kaosu oko sebe, stvarajući remek-djela koja su hvatala bit urbanog života."}
{"category": "unknown", "token_len": 5, "text": "नमस्ते!"}
{"category": "unknown", "token_len": 20, "text": "तेज़ भूरी लोमड़ी आलसी कुत्ते के ऊपर कूदती है।"}
{"category": "unknown", "token_len": 84, "text": "व्यस्त शहर के दिल में, जहाँ गगनचुंबी इमारतें बादलों को छूती थीं और सड़कें अंतहीन गतिविधि से गूंजती थीं, कलाकारों का एक छोटा समुदाय रहता था जो अपने आसपास की अराजकता में प्रेरणा पाते थे, ऐसी कृतियों का निर्माण करते थे जो शहरी जीवन के सार को पकड़ती थीं।"}
{"category": "unknown", "token_len": 5, "text": "নমস্কার!"}
{"category": "unknown", "token_len": 20, "text": "দ্রুত বাদামী শিয়াল অলস কুকুরের উপর দিয়ে লাফ দেয়।"}
{"category": "unknown", "token_len": 97, "text": "ব্যস্ত শহরের হৃদয়ে, যেখানে আকাশচুম্বী ভবনগুলি মেঘ স্পর্শ করত এবং রাস্তাগুলি অবিরাম কার্যকলাপে গুঞ্জন করত, সেখানে শিল্পীদের একটি ছোট সম্প্রদায় বাস করত যারা তাদের চারপাশের বিশৃঙ্খলায় অনুপ্রেরণা খুঁজে পেত, শহুরে জীবনের সারমর্ম ধারণ করে এমন মাস্টারপিস তৈরি করত।"}
{"category": "unknown", "token_len": 4, "text": "வணக்கம்!"}
{"category": "unknown", "token_len": 22, "text": "வேகமான பழுப்பு நரி சோம்பேறி நாயின் மீது குதிக்கிறது."}
{"category": "unknown", "token_len": 98, "text": "பரபரப்பான நகரின் இதயத்தில், வானளாவிய கட்டிடங்கள் மேகங்களைத் தொட்டு, தெருக்கள் முடிவில்லாத செயல்பாடுகளால் ஒலித்துக் கொண்டிருந்த இடத்தில், கலைஞர்களின் சிறிய சமூகம் வாழ்ந்தது, அவர்கள் தங்களைச் சுற்றியுள்ள குழப்பத்தில் உத்வேகம் கண்டு, நகர்ப்புற வாழ்க்கையின் சாரத்தைப் பிடிக்கும் தலைசிறந்த படைப்புகளை உருவாக்கினர்."}
{"category": "unknown", "token_len": 4, "text": "नमस्कार!"}
{"category": "unknown", "token_len": 24, "text": "छिटो खैरो स्याल अल्छी कुकुरमाथि हाम फाल्छ।"}
{"category": "unknown", "token_len": 87, "text": "व्यस्त शहरको मुटुमा, जहाँ गगनचुम्बी भवनहरूले बादललाई छुन्थे र सडकहरू अन्तहीन गतिविधिले गुञ्जायमान थिए, त्यहाँ कलाकारहरूको एउटा सानो समुदाय बस्थ्यो जसले आफ्नो वरपरको अराजकतामा प्रेरणा पाउँथे, शहरी जीवनको सार समात्ने उत्कृष्ट कृतिहरू सिर्जना गर्दै।"}
{"category": "unknown", "token_len": 5, "text": "നമസ്കാരം!"}
{"category": "unknown", "token_len": 26, "text": "വേഗമേറിയ തവിട്ടുനിറ കുറുക്കൻ മടിയൻ നായയുടെ മുകളിലൂടെ ചാടുന്നു."}
{"category": "unknown", "token_len": 93, "text": "തിരക്കേറിയ നഗരത്തിന്റെ ഹൃദയത്തിൽ, അംബരചുംബികൾ മേഘങ്ങളെ സ്പർശിക്കുകയും തെരുവുകൾ അനന്തമായ പ്രവർത്തനങ്ങളാൽ മുഴങ്ങുകയും ചെയ്യുന്നിടത്ത്, കലാകാരന്മാരുടെ ഒരു ചെറിയ സമൂഹം ജീവിച്ചു, അവർ ചുറ്റുമുള്ള അരാജകത്വത്തിൽ പ്രചോദനം കണ്ടെത്തി, നഗര ജീവിതത്തിന്റെ സത്ത പകർത്തുന്ന മാസ്റ്റർപീസുകൾ സൃഷ്ടിച്ചു."}
{"category": "unknown", "token_len": 4, "text": "नमस्कार!"}
{"category": "unknown", "token_len": 21, "text": "जलद तपकिरी कोल्हा आळशी कुत्र्यावरून उडी मारतो."}
{"category": "unknown", "token_len": 96, "text": "गजबजलेल्या शहराच्या हृदयात, जिथे गगनचुंबी इमारती ढगांना स्पर्श करत होत्या आणि रस्ते अविरत क्रियाकलापांनी गुंजत होते, तिथे कलाकारांचा एक छोटा समुदाय राहत होता जो त्यांच्या सभोवतालच्या गोंधळात प्रेरणा शोधत होता, शहरी जीवनाचे सार टिपणारी उत्कृष्ट कलाकृती निर्माण करत होता."}
{"category": "unknown", "token_len": 6, "text": "నమస్కారం!"}
{"category": "unknown", "token_len": 26, "text": "వేగవంతమైన గోధుమ రంగు నక్క సోమరి కుక్కపై దూకుతుంది."}
{"category": "unknown", "token_len": 91, "text": "రద్దీగా ఉండే నగరం యొక్క గుండెలో, ఆకాశహర్మ్యాలు మేఘాలను తాకుతూ మరియు వీధులు అంతులేని కార్యకలాపాలతో సందడి చేస్తున్న చోట, కళాకారుల చిన్న సమాజం నివసించింది, వారు తమ చుట్టూ ఉన్న గందరగోళంలో ప్రేరణ పొందారు, పట్టణ జీవిత సారాన్ని పట్టుకునే కళాఖండాలను సృష్టించారు."}
{"category": "unknown", "token_len": 5, "text": "ನಮಸ್ಕಾರ!"}
{"category": "unknown", "token_len": 18, "text": "ವೇಗದ ಕಂದು ನರಿ ಸೋಮಾರಿ ನಾಯಿಯ ಮೇಲೆ ಜಿಗಿಯುತ್ತದೆ."}
{"category": "unknown", "token_len": 98, "text": "ಗದ್ದಲದ ನಗರದ ಹೃದಯದಲ್ಲಿ, ಆಕಾಶಸ್ಪರ್ಶಿ ಕಟ್ಟಡಗಳು ಮೋಡಗಳನ್ನು ಮುಟ್ಟುತ್ತಿದ್ದ ಮತ್ತು ಬೀದಿಗಳು ಅಂತ್ಯವಿಲ್ಲದ ಚಟುವಟಿಕೆಯಿಂದ ಝೇಂಕರಿಸುತ್ತಿದ್ದ ಸ್ಥಳದಲ್ಲಿ, ಕಲಾವಿದರ ಸಣ್ಣ ಸಮುದಾಯ ವಾಸಿಸುತ್ತಿತ್ತು, ಅವರು ತಮ್ಮ ಸುತ್ತಲಿನ ಗೊಂದಲದಲ್ಲಿ ಸ್ಫೂರ್ತಿ ಪಡೆದರು, ನಗರ ಜೀವನದ ಸಾರವನ್ನು ಹಿಡಿಯುವ ಮಹಾಕೃತಿಗಳನ್ನು ರಚಿಸಿದರು."}
{"category": "code", "token_len": 12, "text": "def hello_world():\n print('Hello, World!')"}
{"category": "code", "token_len": 18, "text": "const sum = (a, b) => a + b; // ES6 arrow function"}
{"category": "code", "token_len": 14, "text": "public class Main { public static void main(String[] args) {} }"}
{"category": "code", "token_len": 14, "text": "#include <stdio.h>\nint main() { return 0; }"}
{"category": "special", "token_len": 9, "text": "Hello! 👋 How are you? 😊"}
{"category": "special", "token_len": 18, "text": "Math: ∑(i=1 to n) = n(n+1)/2"}
{"category": "special", "token_len": 11, "text": "→ ← ↑ ↓ ⇒ ⇐ ⇑ ⇓"}
{"category": "edge", "token_len": 0, "text": ""}
{"category": "edge", "token_len": 1, "text": " "}
{"category": "edge", "token_len": 1, "text": "a"}
{"category": "repetitive", "token_len": 13, "text": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}
{"category": "repetitive", "token_len": 51, "text": "word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word word "}
{"category": "repetitive", "token_len": 4, "text": "\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n"}
{"category": "repetitive", "token_len": 3, "text": " "}
{"category": "mixed", "token_len": 12, "text": "The price is $42.99 for 3 items!"}
{"category": "mixed", "token_len": 15, "text": "Email: user@example.com | Phone: +1-555-0123"}
{"category": "mixed", "token_len": 13, "text": "Python 3.12 新特性：类型注解增强"}
{"category": "rtl", "token_len": 4, "text": "مرحبا بالعالم"}
{"category": "rtl", "token_len": 10, "text": "שלום עולם! זה טקסט בעברית."}
{"category": "rtl", "token_len": 13, "text": "The year 2024 is שנת תשפ״ד in Hebrew"}
{"category": "rtl", "token_len": 5, "text": "اللغة العربية جميلة جداً"}
{"category": "special_encoding", "token_len": 7, "text": "naïve, crème brûlée"}
{"category": "special_encoding", "token_len": 18, "text": "Á (A + U+0301) vs Á (U+00C1)"}
{"category": "special_encoding", "token_len": 8, "text": "радиационно-химическая защита"}
{"category": "special_encoding", "token_len": 11, "text": "Apple vs Аpple (A is Cyrillic)"}
{"category": "special_encoding", "token_len": 3, "text": "\u0000\u0001\b"}
{"category": "special_encoding", "token_len": 14, "text": "café (café) vs café (café)"}
{"category": "special_encoding", "token_len": 24, "text": "🏳️🌈 🏴☠️ 👨👩👧👦"}
{"category": "special_encoding", "token_len": 30, "text": "ℌ𝔢𝔩𝔩𝔬 𝔚𝔬𝔯𝔩𝔡"}
{"category": "structured_format", "token_len": 11, "text": "https://www.example.com/path?query=test#fragment"}
{"category": "structured_format", "token_len": 10, "text": "C:\\Users\\Default\\Documents\\file.txt"}
{"category": "structured_format", "token_len": 9, "text": "<div class=\"main\">Hello</div>"}
{"category": "structured_format", "token_len": 12, "text": "ISBN 978-4-00-310101-8"}
{"category": "structured_format", "token_len": 3, "text": "user@example.com"}
{"category": "structured_format", "token_len": 5, "text": "/usr/local/bin/python3"}
{"category": "structured_format", "token_len": 10, "text": "192.168.1.1:8080"}
{"category": "structured_format", "token_len": 10, "text": "tel:+1-800-555-0123"}
{"category": "noisy_text", "token_len": 9, "text": "This sentance has several misteaks."}
{"category": "noisy_text", "token_len": 8, "text": "I looooveeee programminggg!!!!"}
{"category": "noisy_text", "token_len": 16, "text": "W3lc0m3 t0 th3 m4tr1x."}
{"category": "noisy_text", "token_len": 4, "text": "Hello,,, world."}
{"category": "noisy_text", "token_len": 7, "text": "thisis alloneword withoutspaces"}
{"category": "noisy_text", "token_len": 10, "text": "CAPS LOCK IS CRUISE CONTROL FOR COOL"}
{"category": "noisy_text", "token_len": 13, "text": "h3ll0 w0rld!!1!one!!"}
{"category": "ambiguous_punctuation", "token_len": 9, "text": "This is a state-of-the-art tokenizer."}
{"category": "ambiguous_punctuation", "token_len": 8, "text": "The score was 4-1."}
{"category": "ambiguous_punctuation", "token_len": 13, "text": "I can't go, it's Mr. O'Malley's cat."}
{"category": "ambiguous_punctuation", "token_len": 6, "text": "AT&T is a company."}
{"category": "ambiguous_punctuation", "token_len": 10, "text": "The price is $19.99 (USD)."}
{"category": "ambiguous_punctuation", "token_len": 6, "text": "Visit example.com/page-1"}
{"category": "ambiguous_punctuation", "token_len": 8, "text": "She said \"Hello!\" to me."}
{"category": "code", "token_len": 21, "text": "def factorial(n):\n return 1 if n <= 1 else n * factorial(n-1)"}
{"category": "code", "token_len": 29, "text": "class Person:\n def __init__(self, name: str, age: int):\n self.name = name\n self.age = age"}
{"category": "code", "token_len": 21, "text": "async function fetchData(url) {\n const response = await fetch(url);\n return response.json();\n}"}
{"category": "code", "token_len": 35, "text": "const regex = /^[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\\.[a-zA-Z]{2,}$/;"}
{"category": "code", "token_len": 38, "text": "<!DOCTYPE html>\n<html>\n<head>\n <title>Test Page</title>\n</head>\n<body>\n <h1>Hello World</h1>\n</body>\n</html>"}
{"category": "code", "token_len": 28, "text": "<style>\n .container {\n display: flex;\n justify-content: center;\n align-items: center;\n }\n</style>"}
{"category": "code", "token_len": 40, "text": "SELECT users.name, COUNT(orders.id) as order_count\nFROM users\nLEFT JOIN orders ON users.id = orders.user_id\nGROUP BY users.id\nHAVING order_count > 5;"}
{"category": "code", "token_len": 33, "text": "fn main() {\n let mut vec = vec![1, 2, 3];\n vec.push(4);\n println!(\"{:?}\", vec);\n}"}
{"category": "code", "token_len": 41, "text": "func quickSort[T constraints.Ordered](arr []T) []T {\n if len(arr) < 2 {\n return arr\n }\n pivot := arr[0]\n // ...\n}"}
{"category": "code", "token_len": 56, "text": "#include <iostream>\n#include <vector>\n\nint main() {\n std::vector<int> nums = {1, 2, 3};\n for (auto& n : nums) {\n std::cout << n << \" \";\n }\n return 0;\n}"}
{"category": "json", "token_len": 20, "text": "{\"name\": \"John Doe\", \"age\": 30, \"city\": \"New York\"}"}
{"category": "json", "token_len": 34, "text": "{\"users\": [{\"id\": 1, \"name\": \"Alice\"}, {\"id\": 2, \"name\": \"Bob\"}], \"total\": 2}"}
{"category": "json", "token_len": 27, "text": "{\"unicode\": \"Hello 世界 🌍\", \"escaped\": \"Line 1\\nLine 2\", \"null_value\": null}"}
{"category": "jsonl", "token_len": 45, "text": "{\"event\": \"click\", \"timestamp\": 1234567890}\n{\"event\": \"scroll\", \"timestamp\": 1234567891}\n{\"event\": \"click\", \"timestamp\": 1234567892}"}
{"category": "jsonl", "token_len": 28, "text": "{\"text\": \"Hello world\", \"label\": \"greeting\"}\n{\"text\": \"How are you?\", \"label\": \"question\"}"}