<>iYSSKrSSKJr SSKJr SSKrSSKrSSKrSSKrSSK r SSK r SSK r SSKrSSKJrJrJrJr SrSSjrSrSrS r"S S \R45r"S S \5r"SS\5r"SS\\ R<5r"SS\\ R<5r "SS\\ R<5r!\ RDRF"SS\\ R<55r$g!\ a Sr Nf=f)N) OrderedDict)Decimal) read_json open_json ReadOptions ParseOptionsc#t# [RnUShvN UHnUH nX-v M M gN7fN)stringascii_lowercase)lettersfirstseconds V/var/www/html/land-tabula/venv/lib/python3.13/site-packages/pyarrow/tests/test_json.pygenerate_col_namesr%s:$$GF. s 868c [RRS5RSSX4S9n[ [ R "[5U55n/nURH\n[[XF5VVs/sHupxU[U54PM snn5n UR[R"U 55 M^ URU5R!5n UV s/sH+n ["R$"U ["R&"5S9PM- n n ["R(R+X5n X4$s snnfs sn f)N*r)size)type)nprandom RandomStaterandintlist itertoolsislicerTrzipintappendjsondumpsjoinencodepaarrayint64Table from_arrays)num_colsnum_rowslineseparr col_nameslinesrowkvjson_objdatacolcolumnsexpecteds rmake_random_jsonr9.s ))   # + +At8:N + OCY%%&8&:HEFI Euu#i:MN:MCF :MNO TZZ)* <<  % % 'D9<=#rxx"((*-G=xx##G7H > O>s <D? )2Ec U"S0UD6nURURUURS95nUR5HupV[ XE5U:XaMe g)N)protocol)loadsr#HIGHEST_PROTOCOLitemsgetattr)clspickler attr_valuesoptsnew_optsnamevalues rcheck_options_class_picklingrH;sb   D}}W]]44;4L4L+NOH"((* x&%///+c0[nU"5nURS:deSUlURS:XdeURSLdeSUlURSLdeU"SSS9nURS:XdeURSLde[XSSS9 g)Nri90TFi) block_size use_threads)rBrKrL)rrKrLrH) pickle_modulerArDs rtest_read_optionsrNCs C 5D ??Q  DO ??e ## #   t ## #D   u $$ $ $E 2D ??d "" "   u $$ $ ,0-24rIc0[nU"5nURSLdeURbeSUlURSLde[R"[R "S[R "55/5nX2lURU:XdeURS:XdeSHnXBlURU:XaMe [R"[5 SUlSSS5 [XUSSS9 g!,(df  N=f) NFTfooinfer)ignoreerrorrQz invalid-valuerR)rBexplicit_schemanewlines_in_valuesunexpected_field_behavior) rrUrTr&schemafieldint32rVpytestraises ValueErrorrH)rMrArDrWrGs rtest_parse_optionsr]Xs C 5D  " "e ++ +    '' '"D  " "d ** * YY 34 5F!   6 )) )  ) )W 44 4-).&--666. z ")8& #!1749;CE # "s *D Dc\rSrSr\R S5rSrSrSr Sr Sr Sr S r S rS rS r\R$R&S 5r\R$R&S5r\R$R&S5rSrg) BaseTestJSONsc [e)z{ :param b: bytes to be parsed :param kwargs: arguments passed on to open the json file :return: b parsed as a single Table )NotImplementedErrorselfbkwargss r read_bytesBaseTestJSON.read_bytests "!rIcUR[U5:XdeURVs/sHo3RPM snU:Xdegs snfr ) num_columnslenr7rF)rdtablenamescs r check_namesBaseTestJSON.check_names}s@  CJ... % . 1 .%777.sA c Sn[5n[5nXS-4HnSHnXSlSUl[R "[ SS9 URXBUS9 SSS5 [SS 5H3nXblURXBUS9nUR5S /S Q0:XaM3e M M g!,(df  NZ=f) Ns{"a": 1} {"a": 2} {"a": 3} FTztry to increase block sizematch read_options parse_options a)) rrrUrKrZr[r\rgrange to_pydict)rdrowsrxryr5rUrKrls rtest_block_sizesBaseTestJSON.test_block_sizess."} $ %<(D&3"3E0*+ ']]:)EGOOD2?$AG#(2,J.8+ OOD:G,IE ??,i0@@@@ #/'4)GGs B00 B> cjSnURU5nUR5SS/SS/SS/S.:Xdeg) Ns/{"a": 1,"b": 2, "c": 3} {"a": 4,"b": 5, "c": 6}r}rtr~rr|rern)rgr)rdrrls rtest_no_newline_at_end#BaseTestJSON.test_no_newline_at_endsHB% QQQ%    rIc>SnURU5n[R"S[R"54S[R"54S[R"54/5nURU:XdeUR 5SS/SS/S S /S .:Xdeg) Ns0{"a": 1,"b": 2, "c": 3} {"a": 4,"b": 5, "c": 6} r|rernr}rtr~rrrr)rgr&rWr(rrdrrlrWs rtest_simple_intsBaseTestJSON.test_simple_intssD%S"((*- "((*- "((*-/0||v%%% QQQ%    rIcpSnURU5n[R"S[R"54S[R"54S[R "54S[R "54/5nURU:XdeUR5SS/SS /S S /S S /S.:Xdeg)NsQ{"a": 1,"b": 2, "c": "3", "d": false} {"a": 4.0, "b": -5, "c": "foo", "d": true} r|rernd?@r~3rPFTr|rernr)rgr&rWfloat64r(r bool_rrs rtest_simple_variedBaseTestJSON.test_simple_varieds@%S"**,/ "((*- "))+. "((*-/0||v%%% sRu %    rIc SnURU5n[R"S[R"54S[R"54S[R "54S[R "54S[R"54/5nURU:XdeUR5/SQ/SQ/S Q/S Q/S QS .:Xdeg) Ns{"a": 1, "b": 2, "c": null, "d": null, "e": null} {"a": null, "b": -5, "c": "foo", "d": null, "e": true} {"a": 4.5, "b": null, "c": "nan", "d": null,"e": false} r|rernre)rNg@)r~rN)NrPnan)NNN)NTF)r|rernrr) rgr&rWrr(r nullrrrs rtest_simple_nullsBaseTestJSON.test_simple_nullssM%S"**,/ "((*- "))+. "''), "((*- /0 ||v%%% !%#$ %    rIcSnURU5n[R"S[R"[R"554/5nURU:XdeUR 5S//0:Xdeg)N {"a": []}r|)rgr&rWlist_rrrs rtest_empty_listsBaseTestJSON.test_empty_listssg%S"((2779"5678||v%%% S2$K///rIcSnURU5n[R"/5nURU:XdeURS:XdeURS:Xdeg)Ns{} {} rr~)rgr&rWrjr,rs rtest_empty_rowsBaseTestJSON.test_empty_rowssZ%2||v%%%  A%%%~~"""rIcSnS[S5[S5[S5S/0n[R[R[R[R 4nUHcn[R "SU"SS54/5n[US9nURXS 9nUR U:XdeUR5U:XaMce g) Ns'{"a": 1} {"a": 1.45} {"a": -23.456} {} r|1z1.45z-23.456rzrtrTry) rr& decimal32 decimal64 decimal128 decimal256rWrrgr)rdrr8 decimal_types type_factoryrWrDrls rtest_explicit_schema_decimal)BaseTestJSON.test_explicit_schema_decimals '#,1CTJ r||R]]BMMR )LYYl1a&8 9:;F7DOODO=E<<6) ))??$0 00 *rIcSn[R"S[R"54/5n[US9nUR XS9nUR[R"S[R"54S[R "54/5:XdeUR 5SS/SS /S .:Xde[US S 9nUR XS9nUR[R"S[R"54/5:XdeUR 5SSS/0:Xde[US S 9n[R"[RSS9 UR XS9 SSS5 g!,(df  g=f)Ns2{"foo": "bar", "num": 0} {"foo": "baz", "num": 1} rPrrnumsbarsbazrr})rPrrR)rTrVrS"JSON parse error: unexpected fieldru) r&rWbinaryrrgr(rrZr[ ArrowInvalid)rdrrWrDrls r.test_explicit_schema_with_unexpected_behaviour;BaseTestJSON.test_explicit_schema_with_unexpected_behaviours. BIIK   F39||ryy BIIK BHHJ *      F#q6%    F6>@9||ryy BIIK *      FF#%    F6=? ]]2??!EG OODO 5GGGs E++ E9c[SSS9upURU5nURUR:XdeURU5(deUR 5UR 5:Xdeg)Nr~ r+r,)r9rgrWequalsr)rdr5r8rls rtest_small_random_json#BaseTestJSON.test_small_random_jsonsg)1rB%||x...||H%%%% H$6$6$8888rIc[SSS9up[SS9nURXS9nURS:XdeURS:Xdeg)Nr~irirKrx)r9rrgr,)rdr5r8rxrls rtest_load_large_json!BaseTestJSON.test_load_large_json!sP)1vF"l; @~~'''  F***rIc [SSS9up[5n[5nXRS54HnSHnXdlSHqnXslUR XSUS9nURUR:XdeURU5(aMMUR5UR5:XaMqe M M g)Nr~drs rs)%rw) r9rrrstriprUrKrgrWrr) rd data_baser8rxryr5rUrKrls rtest_stress_block_sizes$BaseTestJSON.test_stress_block_sizes*s/CH "} $  0 0 9:D&3"3E0".J.8+ OOD:G,IE <<8??::: <<11$0H4F4F4HHHH#/'4;rIr<N)__name__ __module__ __qualname____firstlineno__abcabstractmethodrgrorrrrrrrrrrZmarknumpyrrr__static_attributes__r<rIrr_r_ss""8A,    " (0#1"#6J [[99 [[++ [[IIrIr_c&\rSrSrSrSrSrSrg)BaseTestJSONReadi>c PUR"[R"U540UD6$r )rr& py_bufferrcs rrgBaseTestJSONRead.read_bytes@~~bll1o888rIcbSnS/S/S.n[R"U5nURU5nUR5U:Xde[R"UR 55n[ R"[5 URU5 SSS5 g!,(df  g=f)N{"a": 1, "b": 2} r}r~r|re) ioBytesIOrrStringIOdecoderZr[ TypeError)rdr5 expected_databiorlsios rtest_file_object!BaseTestJSONRead.test_file_objectCs~$ c, jjs# M111kk$++-( ]]9 % NN3 & % %s B  B.c "Sn[[U5S9nSSS/4SS//4SS/S///4SS0/4S SS S0S S S00/44HRup4URX-US 9nS U0nUR5U:XdeUR S 5R S:aMRe g)Ns"{ } rs{"a": 0}rrs{"a": []} {"a": [[1]]}r}s {"a": {}}s {"a": {}} {"a": {"b": {"c": 1}}}rernrr|)rrkrgrcolumn num_chunks)rd first_rowrx next_rowsexpected_pylistrlr8s rtest_reconcile_across_blocks-BaseTestJSONRead.test_reconcile_across_blocksNs: "c)n= 4) $ D": & '$aSE): ; D": & 1S$K#Qx 1 3 + &IOOI$91=$?E_-H??$0 00<<$//!3 33+ rIr<N)rrrrrgrrrr<rIrrr>s9  4rIrcn\rSrSrSrSrSrSrSrSr Sr S r S r S r S rS rSrSrSrSrg)BaseTestStreamingJSONReadibcvURS[55nURUl[U/UQ70UD6$)z Reads the JSON file into memory using pyarrow's open_json json The JSON bytes args Positional arguments to be forwarded to pyarrow's open_json kwargs Keyword arguments to be forwarded to pyarrow's open_json rx) setdefaultrrLr)rdr"argsrfrxs rr#BaseTestStreamingJSONRead.open_jsoncs;((G #'#3#3  ////rIc PUR"[R"U540UD6$r )rr&rrcs r open_bytes$BaseTestStreamingJSONRead.open_bytesnrrIcURU:Xde[U5n[U5[U5:Xde[XC5H<upVUR SS9 URU:XdeUR 5U:XaM<e g)NTfull)rWrrkrvalidater)rdreaderexpected_schemarbatchesbatchexpected_batchs r check_reader&BaseTestStreamingJSONRead.check_readerqs|}}///v,7|s=1111%(%@ !E NNN %<"} "$ ))c288:%6$78!1M}}///%%'113 !8    ]] OOE   " " $  ]]= )  " " $* )   * )+C8D 8 D DcSn[5nSUl[R"[R SS9 UR XS9 SSS5 g!,(df  g=f)Ns{"n": } {"n": 10000}!JSON parse error: Invalid value.*rurrrdbad_first_blockrxs rtest_bad_first_parse.BaseTestStreamingJSONRead.test_bad_first_parsesM2"} "$  ]]2??!DF OOOO GFFFrcSn[5nSUl[R"[R SS9 UR XS9 SSS5 g!,(df  g=f)Ns"{ }{"n": } {"n": 10000}rrrurrr s r!test_bad_middle_parse_after_empty;BaseTestStreamingJSONRead.test_bad_middle_parse_after_emptysM@"} "$  ]]2??!DF OOOO GFFFrc4Sn[5nSUl[R"S[R"54/5nUR XS9nURU:XdeUR 5R5SS/0:Xde[R"[RSS9 UR 5 SSS5 [R"[5 UR 5 SSS5 g!,(df  NB=f!,(df  g=f)Ns%{"n": 1000} {"n": 200 00} {"n": 3000}rnrrz@JSON parse error: Missing a comma or '}' after an object member*rurrs rtest_bad_middle_parse/BaseTestStreamingJSONRead.test_bad_middle_parsesE"} "$ ))c288:%6$78!1M}}///%%'113 $8    ]] OO1  " " $  ]]= )  " " $* )  * )rc:Sn[SS9n[SS9n[R"S[R"54/5nUR UUUS9nURU:XdeUR 5R5SS/0:Xde[R"[RS S 9 UR 5 SSS5 [R"[5 UR 5 SSS5 g!,(df  NB=f!,(df  g=f Ns{"n": 0}{1} {"n": 2}rrTrUr(rwrJSON parse error *ru rrr&rWr(rrrrZr[rrrdrrxryrrs r%test_non_linewise_chunker_first_block?BaseTestStreamingJSONRead.test_non_linewise_chunker_first_block3"b1 $= ))c288:%6$78 %'!)}}///%%'113 !8    ]]2??!57  " " $7]]= )  " " $* ) 77* ).C;!D ; D  Dc:Sn[SS9n[SS9n[R"S[R"54/5nUR UUUS9nURU:XdeUR 5R5SS/0:Xde[R"[RS S 9 UR 5 SSS5 [R"[5 UR 5 SSS5 g!,(df  NB=f!,(df  g=fr,r/r0s r)test_non_linewise_chunker_bad_first_blockCBaseTestStreamingJSONRead.test_non_linewise_chunker_bad_first_blockr3r4cSn[SS9n[SS9n[R"S[R"54/5nUR UUUS9nURU:XdeUR 5R5SS/0:XdeUR 5R5SS /0:Xde[R"[RS S 9 UR 5 SSS5 [R"[5 UR 5 SSS5 g!,(df  NB=f!,(df  g=f) Ns&{"n": 0} {"n": 1} {}"n":2} {"n": 3}rrTr-r(rwrr}r.rur/r0s r*test_non_linewise_chunker_bad_middle_blockDBaseTestStreamingJSONRead.test_non_linewise_chunker_bad_middle_blocks(G"b1 $= ))c288:%6$78 %'!)}}///%%'113 !8    %%'113 !8    ]]2??!57  " " $7]]= )  " " $* ) 77* )sD"D3" D03 EcSn[R"S[R"54S[R"54/5n[ SS9n[ US9nS/S/S .nUR UUUS 9nURXbU/5 g) Ns {"b": true, "s": "foo"}resrrTrP)rer<rw)r&rWrutf8rrrr)rdleading_empty_chunkrTrxryrrs r test_ignore_leading_empty_blocks:BaseTestStreamingJSONRead.test_ignore_leading_empty_blocks s>)) "((*  "'') %  #b1 $_E ug  %'!) &M?CrIcSn[R"S[R"54S[R"54/5nS/S/S.n[ SS9n[ S S 9nUR UUUS 9nURU:XdeUR5R5U:Xde[R"[RS S 9 UR5 SSS5 [R"S[R"54S[R"54S[R"54/5nSS/SS/SS/S.n[ SS9nUR XUS 9nURU:XdeUR5R5U:Xde[R"[RS S 9 UR5 SSS5 [R"S[R"54S[R"54S[R"54S[R"54/5n/SQ/SQ/SQ/SQS.n[ SS9nUR XUS 9nURU:XdeUR5R5U:Xdeg!,(df  GN=f!,(df  N=f)NsI{"a": 0, "b": "foo" } {"a": 1, "c": true } {"a": 2, "d": 4.0}r|rerrPr rrQ)rVrwrrurnr}Tr@r)rr}r~)rPNN)NTN)NNrr`)r&rWr(r>rrrrrrZr[rrr)rdrrrrxryrs rtest_inference(BaseTestStreamingJSONRead.test_inferencesz3)) "((*  "'') %   !c0 "b1 $wG  %'!)}}///%%'113}DDD ]]2??!EG  " " $G)) "((*  "'')  "((* %   !!fE4=d|L "b1 /<!>}}///%%'113}DDD ]]2??!EG  " " $G)) "((*  "'')  "((*  "**,  %   (.A07HJ "b1 /<!>}}///%%'113}DDD?GGGGsJ7J/ J,/ J=r<N)rrrrrrrrgrrrr"r%r)r1r6r9r@rFrr<rIrrrbsS 0977DH%(HH%*%*%*%2D$0ErIrc\rSrSrSrSrg)TestSerialJSONReadiQc|URS[55nSUl[U0UD6nUR SS9 U$)NrxFTrrrrLrrrdrrfrxrls rrTestSerialJSONRead.read_jsonSs@((G #(  4*6* D! rIr<Nrrrrrrr<rIrrIrIQrIrIc\rSrSrSrSrg)TestParallelJSONReadi[c|URS[55nSUl[U0UD6nUR SS9 U$)NrxTrrKrLs rrTestParallelJSONRead.read_json]s@((G #'  4*6* D! rIr<NrNr<rIrrQrQ[rOrIrQc\rSrSrSrSrg)TestSerialStreamingJSONReadieFr<NrrrrrLrr<rIrrUrUesKrIrUc\rSrSrSrSrg)TestThreadedStreamingJSONReadijTr<NrVr<rIrrXrXjs KrIrX)r~rz )%r collectionsrdecimalrrrr"r unittestrr ImportErrorrZpyarrowr& pyarrow.jsonrrrrrr9rHrNr]ABCr_rrTestCaserIrQrUr threadingrXr<rIrrbs$ #  HH! 04*E6HI377HIV!4|!4HlE lE^)8+<+<+X->->";X=N=N $=x?P?P] BsC,,C76C7