{"meta":{"sha":"3e352cca660658d4b5c90f42a7808b11469e4c66"},"files":[{"path":".gitignore","mode":"100644","sha":"42a1a625a22e9e315ddffcfa656c3f311576a1c9","size":113},{"path":"CODE_OF_CONDUCT.md","mode":"100644","sha":"08b500a221857ec3f451338e80b4a9ab1173a1af","size":3541},{"path":"CONTRIBUTING.md","mode":"100644","sha":"fd6fbec6d5ad44923bb1bc206b33f5ca9e8b67f3","size":1255},{"path":"LICENSE.PE","mode":"100644","sha":"261eeb9e9f8b2b4b0d119366dda99c6fd7d35c64","size":11357},{"path":"LICENSE.PLM","mode":"100644","sha":"96372f90a1b9be33e955d1b0482534f0651aee84","size":11529},{"path":"README.md","mode":"100644","sha":"793d92f130af7305fcce7a28044881a6bc76ad08","size":27165},{"path":"apps/detection/DETA_pe/README.md","mode":"100644","sha":"4ecc3d4001f6b05912a1741b4af7ed48685d67e8","size":1615},{"path":"apps/detection/DETA_pe/datasets/__init__.py","mode":"100644","sha":"f154383b7114f25835c2b7161a1ab1f361f73305","size":1483},{"path":"apps/detection/DETA_pe/datasets/coco.py","mode":"100644","sha":"74a55f8f565fbf8875ccf7866389c0a44041ffd6","size":11582},{"path":"apps/detection/DETA_pe/datasets/coco_eval.py","mode":"100644","sha":"9a3ebe7e7d12d07b35d655d1f8f192d44e885cac","size":9171},{"path":"apps/detection/DETA_pe/datasets/coco_panoptic.py","mode":"100644","sha":"e856e49d84853e5feb78ec0cf002677375cff2bb","size":4159},{"path":"apps/detection/DETA_pe/datasets/data_prefetcher.py","mode":"100644","sha":"7d28d9fdd7f90d2689590c9a126226c068081bd5","size":3085},{"path":"apps/detection/DETA_pe/datasets/objects365.py","mode":"100644","sha":"16a1a240a72e288908e3d8f513e8e4e87de7e314","size":1894},{"path":"apps/detection/DETA_pe/datasets/panoptic_eval.py","mode":"100644","sha":"0dabffdb584210af1836d9ee7e5b12532926e9b0","size":1929},{"path":"apps/detection/DETA_pe/datasets/samplers.py","mode":"100644","sha":"5d3da7142d2523501aeca9d2d1cb6c41955a5465","size":13003},{"path":"apps/detection/DETA_pe/datasets/torchvision_datasets/__init__.py","mode":"100644","sha":"162303c4cea0a2c0c6ecd65143c28b1752cae49a","size":329},{"path":"apps/detection/DETA_pe/datasets/torchvision_datasets/coco.py","mode":"100644","sha":"45b5f52fa9945145dbd48630bac2c2fd42d672b7","size":3285},{"path":"apps/detection/DETA_pe/datasets/transforms.py","mode":"100644","sha":"99c2798e88d1a4e9c31da4cd1135cce41e8efea8","size":9968},{"path":"apps/detection/DETA_pe/engine.py","mode":"100644","sha":"385b27df4794b138b75c3832e6262c9fe0f79bb8","size":10860},{"path":"apps/detection/DETA_pe/engine_tta.py","mode":"100644","sha":"3f95f707aaac0ae4bfa8b598b3c2dbb4c41fa6e1","size":8728},{"path":"apps/detection/DETA_pe/main.py","mode":"100644","sha":"9cb79d8e292811f559daf1f26ea35f0075fa0056","size":26029},{"path":"apps/detection/DETA_pe/models/__init__.py","mode":"100644","sha":"9a59c33484884af523013d1ed2ef57032646336a","size":591},{"path":"apps/detection/DETA_pe/models/assigner.py","mode":"100644","sha":"0238c8aff489fa6a36900faad9939f3d5f57a042","size":16570},{"path":"apps/detection/DETA_pe/models/backbone.py","mode":"100644","sha":"a19daa47b339439ec67e34ef17e0b75533b3267b","size":7987},{"path":"apps/detection/DETA_pe/models/deformable_detr.py","mode":"100644","sha":"2f8cb9e2d74635b4938b1e7b7d2a1ce31e000094","size":30528},{"path":"apps/detection/DETA_pe/models/deformable_transformer.py","mode":"100644","sha":"e4cfd859579766cf3c1d6dfe4ef24634fb7e3e79","size":20537},{"path":"apps/detection/DETA_pe/models/matcher.py","mode":"100644","sha":"63ef0294252e38d073d2c6d11e420e7cd306a7e2","size":4964},{"path":"apps/detection/DETA_pe/models/ops/functions/__init__.py","mode":"100644","sha":"303161cd10022f2db15985b6da9b4d6571572656","size":626},{"path":"apps/detection/DETA_pe/models/ops/functions/ms_deform_attn_func.py","mode":"100644","sha":"e6e80f4ab12d384d9d2a3629b7f0b0c0adb3b591","size":3710},{"path":"apps/detection/DETA_pe/models/ops/make.sh","mode":"100755","sha":"106b685722bc6ed70a06bf04309e75e62f73a430","size":593},{"path":"apps/detection/DETA_pe/models/ops/modules/__init__.py","mode":"100644","sha":"f82cb1ad9d634a87b54ba6a71b58a230bcade5fe","size":584},{"path":"apps/detection/DETA_pe/models/ops/modules/ms_deform_attn.py","mode":"100644","sha":"905f7f19ce9a8fcf7f94c42d45c54411c58373c2","size":6800},{"path":"apps/detection/DETA_pe/models/ops/setup.py","mode":"100644","sha":"a0131bc21cf1b45b90fcf174e2c53e4c08e9c641","size":2559},{"path":"apps/detection/DETA_pe/models/ops/src/cpu/ms_deform_attn_cpu.cpp","mode":"100644","sha":"e1bf854de1f3860d20b6fef5c1a17817c268e70a","size":1256},{"path":"apps/detection/DETA_pe/models/ops/src/cpu/ms_deform_attn_cpu.h","mode":"100644","sha":"81b7b58a3d9502bbb684dc84687a526dedf94cae","size":1139},{"path":"apps/detection/DETA_pe/models/ops/src/cuda/ms_deform_attn_cuda.cu","mode":"100644","sha":"d6d583647cce987196d5ad1968a8a365a379e774","size":7316},{"path":"apps/detection/DETA_pe/models/ops/src/cuda/ms_deform_attn_cuda.h","mode":"100644","sha":"c7ae53f99c820ce6193b608ad344550348a0b42c","size":1140},{"path":"apps/detection/DETA_pe/models/ops/src/cuda/ms_deform_im2col_cuda.cuh","mode":"100644","sha":"6bc2acb7aea0eab2e9e91e769a16861e1652c284","size":54694},{"path":"apps/detection/DETA_pe/models/ops/src/ms_deform_attn.h","mode":"100644","sha":"ac0ef2ec25f7d0ee51ca2d807b159ddf85652017","size":1838},{"path":"apps/detection/DETA_pe/models/ops/src/vision.cpp","mode":"100644","sha":"2201f63a51dca16d0b31148ed2c9e8e47ec15bdc","size":799},{"path":"apps/detection/DETA_pe/models/ops/test.py","mode":"100644","sha":"8dbf6d5547d131f01a8c5c28b76557bd27a9334b","size":4087},{"path":"apps/detection/DETA_pe/models/pev1.py","mode":"100644","sha":"f480366d13234f0d2e5ab3e2c80050475a8710a0","size":22348},{"path":"apps/detection/DETA_pe/models/position_encoding.py","mode":"100644","sha":"a92f0d36aec69ed8d918de0214bae57d335aeb10","size":3788},{"path":"apps/detection/DETA_pe/models/segmentation.py","mode":"100644","sha":"c801c0eaada3df0f286f6288266a00053b82472e","size":15925},{"path":"apps/detection/DETA_pe/models/swin.py","mode":"100644","sha":"51dbb592a3647d09c0eccfbee283e247f2d6ec83","size":27956},{"path":"apps/detection/DETA_pe/models/utils_d2.py","mode":"100644","sha":"2b89a4c3fbe079a77fd0cef947cf9ada787fc55d","size":6360},{"path":"apps/detection/DETA_pe/models/utils_fed_loss.py","mode":"100644","sha":"bafc64d128403a749dae5fa99af4f3f8e3535ade","size":39910},{"path":"apps/detection/DETA_pe/models/utils_softnms.py","mode":"100644","sha":"d390eadc5003e9ffbea17c1344526234da981d6e","size":7243},{"path":"apps/detection/DETA_pe/scripts/eval.sh","mode":"100644","sha":"f7b9f6da70d5aa99ac2af843a74407d0aa14006d","size":891},{"path":"apps/detection/DETA_pe/scripts/eval_1824pix.sh","mode":"100644","sha":"a38c5347114518432f67a7e1906f9daf933843ee","size":898},{"path":"apps/detection/DETA_pe/scripts/eval_tta_slurm.sh","mode":"100644","sha":"e424f0f918702257e93f497c416e453ffd4ac658","size":1774},{"path":"apps/detection/DETA_pe/scripts/eval_tta_slurm_1824pix.sh","mode":"100644","sha":"db96c04e5ed44daba7b8fc42f38dc920510e0e2d","size":1781},{"path":"apps/detection/DETA_pe/scripts/finetune_further_spatial_Gwin384_cocoep3_1824pix_8node.sh","mode":"100644","sha":"8d616bdfc68951f6f8b35ae1c272b6bc2b5f395b","size":1971},{"path":"apps/detection/DETA_pe/scripts/finetune_spatial_Gwin384_cocoep12_1728pix_8node.sh","mode":"100644","sha":"55e78925cf2c0d21a833cc82f54735aed640c945","size":1930},{"path":"apps/detection/DETA_pe/scripts/pretrain_continue_spatial_Gwin384_o365ep6_1536pix_16node.sh","mode":"100644","sha":"c5929b3dd7001ac07dd7b3d73802111c22321d87","size":1902},{"path":"apps/detection/DETA_pe/scripts/pretrain_spatial_Gwin384_o365ep12_1024pix_16node.sh","mode":"100644","sha":"cdafa3321b321c2d5cdea4d80cb1c70d5ee0f9c7","size":1818},{"path":"apps/detection/DETA_pe/util/__init__.py","mode":"100644","sha":"4ebdc90b7f3ac2ed5a085066dcf20722b90cbc77","size":506},{"path":"apps/detection/DETA_pe/util/box_ops.py","mode":"100644","sha":"ca29592f8077cba5f934bb364370ac09adca9e76","size":2997},{"path":"apps/detection/DETA_pe/util/ema.py","mode":"100644","sha":"3c357b544c9b6722e18ab3969331d10970198521","size":706},{"path":"apps/detection/DETA_pe/util/misc.py","mode":"100644","sha":"85bc3f56560d5e1ec803361154b57fc329ae1bf7","size":23142},{"path":"apps/detection/DETA_pe/util/plot_utils.py","mode":"100644","sha":"759f34d252493fd93187ea3cf2ab0d63a3e2b280","size":4664},{"path":"apps/detection/INSTALL.md","mode":"100644","sha":"cb4dd07cde075ecee1f69963b49c09561ac5b284","size":398},{"path":"apps/detection/README.md","mode":"100644","sha":"fee286cddf9258b06dcbd4b799b335f54c26fd7d","size":3521},{"path":"apps/detection/detectron2_pe/__init__.py","mode":"100644","sha":"283d9e0cc7512c4a46792daee78a8ededd7bd56a","size":23},{"path":"apps/detection/detectron2_pe/checkpoint/__init__.py","mode":"100644","sha":"b43ad2512a8206e0f4b4fe133605d457b9e384d2","size":93},{"path":"apps/detection/detectron2_pe/checkpoint/detection_checkpoint.py","mode":"100644","sha":"56fd16f106f9187f9359a9b880f830a532633848","size":6506},{"path":"apps/detection/detectron2_pe/modeling/__init__.py","mode":"100644","sha":"9ca54fc5603de935af1b082f7704cd084ea56bc8","size":59},{"path":"apps/detection/detectron2_pe/modeling/backbone/__init__.py","mode":"100644","sha":"d1626c83bbb6e0ca66796e008a7a3537594e6c57","size":59},{"path":"apps/detection/detectron2_pe/modeling/backbone/pev1_det.py","mode":"100644","sha":"353048f081ceb84e38776f250828f841743af7a6","size":18738},{"path":"apps/detection/projects/ViTDet/configs/COCO/mask_rcnn_PEcore_G_coco75ep.py","mode":"100644","sha":"979f9b1fc66b1c739b809650f6b18d8c2c248c26","size":3058},{"path":"apps/detection/projects/ViTDet/configs/COCO/mask_rcnn_PEspatial_G_coco36ep.py","mode":"100644","sha":"636beb25542a70bd87dc4c1e9a529223ce4782bf","size":3100},{"path":"apps/detection/projects/ViTDet/configs/COCO/mask_rcnn_vitdet_b_100ep.py","mode":"100644","sha":"750dd527521e3ae2edee316681cece7fa9f5d12b","size":1282},{"path":"apps/detection/projects/ViTDet/configs/LVIS/mask_rcnn_PEcore_G_lvis75ep.py","mode":"100644","sha":"27350aa4c14b97da48f6521a29efcfd64022658b","size":4087},{"path":"apps/detection/projects/ViTDet/configs/LVIS/mask_rcnn_PEspatial_G_lvis75ep.py","mode":"100644","sha":"4ea75f68e505310c3c5a90baf0b0070df1a8400b","size":4123},{"path":"apps/detection/projects/ViTDet/configs/common/coco_loader_lsj.py","mode":"100644","sha":"e6c2f1e913a9f629290ce345fc4ffd4db4037e14","size":793},{"path":"apps/detection/scripts/coco/train_mask_rcnn_PEcore_G_coco75ep.sh","mode":"100644","sha":"b9215c4a5fa31205867510daa19e29d3356716e4","size":1410},{"path":"apps/detection/scripts/coco/train_mask_rcnn_PEspatial_G_coco36ep.sh","mode":"100644","sha":"becdfae2693a0902755d8a1d8cafd2fff6e8d5bc","size":1459},{"path":"apps/detection/scripts/evaluate_local.sh","mode":"100644","sha":"b94214b61afbe586f8d3acd3e515803e7e2e0361","size":190},{"path":"apps/detection/scripts/lvis/train_mask_rcnn_PEcore_G_lvis75ep.sh","mode":"100644","sha":"88d7551ac900a4899df88a5dd2b38354b01092ca","size":1410},{"path":"apps/detection/scripts/lvis/train_mask_rcnn_PEspatial_G_lvis75ep.sh","mode":"100644","sha":"7e9bccafbb20d744d88dd30442c32aaaa172a2c6","size":1459},{"path":"apps/detection/tools/convert_d2.py","mode":"100644","sha":"96ff850b575457f102e55d0515fe5eb629ce7d8e","size":4501},{"path":"apps/detection/tools/lazyconfig_train_net_pe.py","mode":"100755","sha":"fc11d408678d457033849bc0a942089d6a997efc","size":4710},{"path":"apps/detection/tools/lazyconfig_train_net_pe_slurm.py","mode":"100755","sha":"c7219d1bb3292c68b689a26cc463c69c162b2371","size":8277},{"path":"apps/pe/README.md","mode":"100644","sha":"349a2b58131b9c85272a79613fbbb44e1010c814","size":23689},{"path":"apps/pe/clip_benchmark/__init__.py","mode":"100644","sha":"883377a4d48ac85243599e4ea9e2a0edaf851e82","size":135},{"path":"apps/pe/clip_benchmark/cli.py","mode":"100644","sha":"7220d347ff03bfc81915f6f8c8427810812bcfa0","size":28341},{"path":"apps/pe/clip_benchmark/datasets/__init__.py","mode":"100644","sha":"e69de29bb2d1d6434b8b29ae775ad8c2e48c5391","size":0},{"path":"apps/pe/clip_benchmark/datasets/audiocaps.py","mode":"100644","sha":"445bc20915e815297dc3586ea52e0daa8541b206","size":2472},{"path":"apps/pe/clip_benchmark/datasets/babel_imagenet.py","mode":"100644","sha":"fd4fd27edf302fde6abed82fb718b1db08b5bb36","size":954},{"path":"apps/pe/clip_benchmark/datasets/builder.py","mode":"100644","sha":"df80e769ff6fa1117209dac813495501b15a76d3","size":89468},{"path":"apps/pe/clip_benchmark/datasets/caltech101.py","mode":"100644","sha":"208304ffe894c7a79b73510b12622ae180272c56","size":9404},{"path":"apps/pe/clip_benchmark/datasets/clotho_v2.py","mode":"100644","sha":"5f14bca343a36077a0550bcfa12aa4df2ed064e9","size":2079},{"path":"apps/pe/clip_benchmark/datasets/crossmodal3600.py","mode":"100644","sha":"582d428d2e89304c0582ed834469e24335293f69","size":4100},{"path":"apps/pe/clip_benchmark/datasets/en_classnames.json","mode":"100644","sha":"86de297547d0ec07b9b7ffe6345b5af4e433fc2e","size":39429},{"path":"apps/pe/clip_benchmark/datasets/en_zeroshot_classification_templates.json","mode":"100644","sha":"f2ca0e0f30bd8b05de537bdaba7afa61b0ca0183","size":17095},{"path":"apps/pe/clip_benchmark/datasets/flickr.py","mode":"100644","sha":"efda2ddcd8e723de5fc2b3eaa2fd57d56b34e7f3","size":1860},{"path":"apps/pe/clip_benchmark/datasets/flickr30k_200.py","mode":"100644","sha":"e8c4da53f9422d4c0569d4958daaeed18f06ea3c","size":3731},{"path":"apps/pe/clip_benchmark/datasets/flores_langs.py","mode":"100644","sha":"928a3c1ab5ea3621485b3a0189529987850cf599","size":3239},{"path":"apps/pe/clip_benchmark/datasets/imagenetv2.py","mode":"100644","sha":"2bef6cbcfad33d2ea774cce9cd0f1380fcd4eec4","size":4702},{"path":"apps/pe/clip_benchmark/datasets/kitti.py","mode":"100644","sha":"4f8cbb06bd03327d9f7ee1b93b0357c5543819d0","size":7135},{"path":"apps/pe/clip_benchmark/datasets/multilingual_mscoco.py","mode":"100644","sha":"49d11500e50a9e1f6fbd86748f6f39eddd586a25","size":4180},{"path":"apps/pe/clip_benchmark/datasets/objectnet.py","mode":"100644","sha":"d2eb4e6033b69a28a347db22f4a2b5701e5e5bd2","size":2834},{"path":"apps/pe/clip_benchmark/datasets/pos_neg_caption_dataset.py","mode":"100644","sha":"c17a889d6dd0f3f5b78fdd17b32d263954ceeaa6","size":1163},{"path":"apps/pe/clip_benchmark/datasets/tfds.py","mode":"100644","sha":"dc18b5deb1dc87d77f9965f6e8f3ab2a01536e6b","size":2069},{"path":"apps/pe/clip_benchmark/datasets/video_classification_dataset.py","mode":"100644","sha":"bcd5d37f5af8494144714c3c3e18233479218ff3","size":4109},{"path":"apps/pe/clip_benchmark/datasets/video_retrieval_dataset.py","mode":"100644","sha":"c499475725849755cc37b39d2c3d5aabf06f5f49","size":2342},{"path":"apps/pe/clip_benchmark/datasets/voc2007.py","mode":"100644","sha":"a771d75721be7a4f0269e5ffc2bc43a0d1a605e7","size":9117},{"path":"apps/pe/clip_benchmark/datasets/winoground.py","mode":"100644","sha":"9095d99b53fab352d133ab2dc696e2d548116022","size":836},{"path":"apps/pe/clip_benchmark/datasets/xtd200.py","mode":"100644","sha":"935ac5a67539c7bffba6f0be527227af56a9c995","size":3679},{"path":"apps/pe/clip_benchmark/metrics/__captioning.py","mode":"100644","sha":"23c7db8494f9e940b0e2c376178a9c96303d08a6","size":3867},{"path":"apps/pe/clip_benchmark/metrics/__init__.py","mode":"100644","sha":"e69de29bb2d1d6434b8b29ae775ad8c2e48c5391","size":0},{"path":"apps/pe/clip_benchmark/metrics/image_caption_selection.py","mode":"100644","sha":"e72b333c75dc4a06b843b44f1c783fd4742f992a","size":3346},{"path":"apps/pe/clip_benchmark/metrics/linear_probe.py","mode":"100644","sha":"2ba38a365bbfc07e5a75b1289bfc7569a77279ba","size":14373},{"path":"apps/pe/clip_benchmark/metrics/multiclass_retrieval.py","mode":"100644","sha":"057d48301b4297919f7ff8064b10d187dffb9b54","size":4159},{"path":"apps/pe/clip_benchmark/metrics/visualization.py","mode":"100644","sha":"994006c0fb833317a3bc8aae7e7500ca9f93b55a","size":5762},{"path":"apps/pe/clip_benchmark/metrics/zeroshot_classification.py","mode":"100644","sha":"ec0ceb5728d3c15fef92a5b89c26b2505dd481bd","size":8970},{"path":"apps/pe/clip_benchmark/metrics/zeroshot_retrieval.py","mode":"100644","sha":"f475b094fcc63b1d8d70a435ff7ab8ea4a87c3ff","size":9815},{"path":"apps/pe/clip_benchmark/model_collection.py","mode":"100644","sha":"01e23e4fde4459704fd576e093d36f07880e8ed0","size":154},{"path":"apps/pe/clip_benchmark/tasks/wds_benchmarks.txt","mode":"100644","sha":"abc2ffc9d94ac899b2f47445a787bfced89fa19d","size":244},{"path":"apps/pe/clip_benchmark/webdataset_builder.py","mode":"100644","sha":"40122b80d255a9bc5328cc2a936b18637e130808","size":11557},{"path":"apps/pe/docs/assets/cat.png","mode":"100644","sha":"aaca6ec7d59ae38fcc25e64f10d3876a3dbd2198","size":34590},{"path":"apps/pe/docs/assets/dog.mp4","mode":"100644","sha":"e83d4cacf0ff6e7ba9746f8aa2bbabe10794a833","size":182022},{"path":"apps/pe/docs/assets/dog.png","mode":"100644","sha":"ff86c5e4b412ef27fa360298e73cc33af44c0296","size":982442},{"path":"apps/pe/docs/assets/office.mp4","mode":"100644","sha":"9606109bb5dcc4cf31d589e60d86f2a24dc45d41","size":7176599},{"path":"apps/pe/docs/assets/spatial_correspondence.png","mode":"100644","sha":"23f3045622519ad66806534bfc18c0ef0374bac2","size":2131734},{"path":"apps/pe/docs/assets/spatial_features.png","mode":"100644","sha":"fe6f8598dcd2ffa8259d9ed07e01aa2e8a3479c9","size":1992530},{"path":"apps/pe/docs/assets/teaser.png","mode":"100644","sha":"84e5539d6bc51703154addb1ed94d2488cd451e5","size":247818},{"path":"apps/pe/docs/assets/train.mp4","mode":"100644","sha":"5c1c879ba94155cc71d1ceb65e32bae7832ee278","size":4092764},{"path":"apps/pe/docs/evaluation.md","mode":"100644","sha":"58201a904d1e1d578c2c790c8970c695dc41d176","size":1732},{"path":"apps/pe/docs/pe_demo.ipynb","mode":"100644","sha":"4cc359be27cd9b36194402029c0430d5009f43ea","size":336930},{"path":"apps/plm/README.md","mode":"100644","sha":"7074c05da377bc6e8010521ece8213eff2e08fd5","size":8649},{"path":"apps/plm/configs/datasets.yaml","mode":"100644","sha":"09611eb758d9dc44aab850d67efb817fa6be785d","size":1021},{"path":"apps/plm/configs/stage_1/plm_1b.yaml","mode":"100644","sha":"f1090cba533353fd6f30bd67baa8121f2e1519c6","size":2244},{"path":"apps/plm/configs/stage_1/plm_3b.yaml","mode":"100644","sha":"182d0e1239c58cb377d20bbdebea61f20e825052","size":2244},{"path":"apps/plm/configs/stage_1/plm_8b.yaml","mode":"100644","sha":"f2bbda7152fbbcd7c2a70ae467d280b833e1ba25","size":2005},{"path":"apps/plm/configs/stage_2/plm_1b.yaml","mode":"100644","sha":"3c907f3cd2ad7a3147aa0b8eaa3b34575bd11a71","size":2115},{"path":"apps/plm/configs/stage_2/plm_3b.yaml","mode":"100644","sha":"cb781505597ae676f37fc8bffa0d29b346eca388","size":2115},{"path":"apps/plm/configs/stage_2/plm_8b.yaml","mode":"100644","sha":"f13b1f990c88bdcad841fc828f4e4d7d762679ff","size":2076},{"path":"apps/plm/configs/stage_3/plm_1b.yaml","mode":"100644","sha":"4a848e5f49f505f4d1707b84b713f582b8368093","size":2116},{"path":"apps/plm/configs/stage_3/plm_3b.yaml","mode":"100644","sha":"9ef19e80527d5a018f723189006c5b51a977e98a","size":2116},{"path":"apps/plm/configs/stage_3/plm_8b.yaml","mode":"100644","sha":"2b7eb775a9ea3fa88343d34e5305600890640b87","size":2077},{"path":"apps/plm/consolidate.py","mode":"100644","sha":"25d231b658937cc6ec012ecffea7b926c0b9eeea","size":1482},{"path":"apps/plm/dataset_conf.py","mode":"100644","sha":"e6b3a5f22388b35022c613bf0cdc4a4e3e2b29de","size":1026},{"path":"apps/plm/docs/evaluation.md","mode":"100644","sha":"6bd0af71c45f0b31ef28f16f3321feccecb9399e","size":2114},{"path":"apps/plm/docs/finetune_example.md","mode":"100644","sha":"223a0421ed0165ba82bfc767ec3ff40efcb8d481","size":7454},{"path":"apps/plm/docs/plm_main_fig.png","mode":"100644","sha":"24967e4032a63559fd55d2ffe383a4b814a5b0d1","size":544743},{"path":"apps/plm/docs/plm_videobench.md","mode":"100644","sha":"93016b0bdf1217a85c3ad02e8d5d18b70cfa6355","size":3450},{"path":"apps/plm/docs/training.md","mode":"100644","sha":"abe235e764aeb7864cc361b0d0d9906d5cfe8557","size":4245},{"path":"apps/plm/generate.py","mode":"100644","sha":"6a9dd85ed594b5b13d6a8605498610da39d9758c","size":23429},{"path":"apps/plm/interpolate_PE_pos_embed.py","mode":"100644","sha":"d6c77af7364f2d09027fdc0a5e5a4ba7295047cc","size":3233},{"path":"apps/plm/notebook_demos/image_and_video_captioning.ipynb","mode":"100644","sha":"1b16bd9a0fc8d15c4ca53f7325b07337b36077db","size":2054973},{"path":"apps/plm/notebook_demos/image_grounding.ipynb","mode":"100644","sha":"a40dc72cdf12abe0cc178a4b969662069ce32f06","size":1450574},{"path":"apps/plm/notebook_demos/multi_image_understanding.ipynb","mode":"100644","sha":"69cf88e880806869d3912d0cff3779d7b8e92446","size":838689},{"path":"apps/plm/tokenizer.py","mode":"100644","sha":"19e6214d531dcfb98b3d354ee06347d7b0674955","size":11049},{"path":"apps/plm/train.py","mode":"100644","sha":"890e85dc1a0cde9d3190f7b44346db6e8d484592","size":23729},{"path":"apps/plm/transformer.py","mode":"100644","sha":"af75dd465434a68621083c3676bdf1edec2abb64","size":10382},{"path":"core/__init__.py","mode":"100644","sha":"e69de29bb2d1d6434b8b29ae775ad8c2e48c5391","size":0},{"path":"core/args.py","mode":"100644","sha":"be094900af7939550a8c3640fd8ca671a8cb5e7f","size":2291},{"path":"core/audio_visual_encoder/__init__.py","mode":"100644","sha":"4be661e8f46cbfd206e62fe74333a6209663d8bf","size":277},{"path":"core/audio_visual_encoder/aligner.py","mode":"100644","sha":"0106420066c01e2086775fe26d67b82aa6b2d28e","size":2029},{"path":"core/audio_visual_encoder/audio_codec.py","mode":"100644","sha":"3c2432967f15c3104f8e68e7d9cd0ee2aeb5107c","size":1486},{"path":"core/audio_visual_encoder/config.py","mode":"100644","sha":"5dc82bd6e3f27ccb98eca4d154bb9b575ca7aa55","size":4569},{"path":"core/audio_visual_encoder/patcher.py","mode":"100644","sha":"9f15c8a10423a470812ae933b10b0405fcb096d9","size":2258},{"path":"core/audio_visual_encoder/pe.py","mode":"100644","sha":"b32fef8c537ba350e09b10cd3b79bab5e324bd66","size":24089},{"path":"core/audio_visual_encoder/transformer.py","mode":"100644","sha":"a3578381c2f74fb61629d1db7926935587b36386","size":7898},{"path":"core/audio_visual_encoder/transforms.py","mode":"100644","sha":"734b641e58ecf026108bb42ec87dba63be02fa89","size":10207},{"path":"core/checkpoint.py","mode":"100644","sha":"c1610baaa42ae63a3d1c9cc734c7c1cb5bfff1f5","size":13185},{"path":"core/data/__init__.py","mode":"100644","sha":"e69de29bb2d1d6434b8b29ae775ad8c2e48c5391","size":0},{"path":"core/data/conversation.py","mode":"100644","sha":"3fb98e697c461f55f05a720c51973531cb8c82d2","size":7058},{"path":"core/data/data.py","mode":"100644","sha":"1a29820a74e61119032f26a128189e508ec9e367","size":28417},{"path":"core/data/data_collators.py","mode":"100644","sha":"59a909eb687dbfcdbeb521965f246b503ceaffde","size":4549},{"path":"core/data/data_mixer.py","mode":"100644","sha":"a4d523f98af1b3f560ac8bf861511d4bbf8d42e8","size":16349},{"path":"core/data/dataloader.py","mode":"100644","sha":"4af65174029ca13ea764509e60737a85e181bff1","size":3259},{"path":"core/data/preprocessor.py","mode":"100644","sha":"1e0d6fea844e8f992349721fb37369c26524479e","size":5177},{"path":"core/distributed.py","mode":"100644","sha":"4078fde0f3b647297d364dd21c605cec37ab629b","size":16195},{"path":"core/logger.py","mode":"100644","sha":"4b8afc74f40a7695759d984de88d4a6dd8a65001","size":4214},{"path":"core/metrics.py","mode":"100644","sha":"9bb6ceadcaf39e3f47923e2fb7616ff25f6d3415","size":8184},{"path":"core/optim.py","mode":"100644","sha":"dc88eaf79278069f908d9ffc22617e2980797c57","size":4611},{"path":"core/probe.py","mode":"100644","sha":"fb817226c5358cf6fcb833b355d92f57d96684cd","size":23976},{"path":"core/profiling.py","mode":"100644","sha":"9ff90438c4ca711ac5059272b2477be63cdadb31","size":4399},{"path":"core/stool.py","mode":"100644","sha":"8754ee4c46d89a5619fe341b82a5921c19439990","size":7363},{"path":"core/tests/Rock-climbing-Canada-1920x1147.jpg","mode":"100644","sha":"3eb48c97077840a339971baf6896f720ff9929f0","size":213811},{"path":"core/tests/dataloader_test.py","mode":"100644","sha":"9c9341dce3a2fed5b538eff200671b870591a8b0","size":2474},{"path":"core/tests/llama3_tokenizer_test.py","mode":"100644","sha":"981baa2cdc9a4e0a45fafc10bb29435cd492c778","size":3093},{"path":"core/tests/ocrbench_centre.jpg","mode":"100644","sha":"1dd9b44fd6e902ede30942e9d19484b9c5246ac2","size":1222},{"path":"core/tests/selfie_cathedral_peak.jpg","mode":"100644","sha":"c1cc918d5c5f502be1dd76e5b9ff38c2758bcc53","size":967265},{"path":"core/tokenizer.py","mode":"100644","sha":"9a4090a21c9763298137c2e40b1084f5893444d0","size":6590},{"path":"core/transformer.py","mode":"100644","sha":"6f76f907c20c06a2e166574fe9f565b10b63e3c8","size":20950},{"path":"core/transforms/__init__.py","mode":"100644","sha":"e69de29bb2d1d6434b8b29ae775ad8c2e48c5391","size":0},{"path":"core/transforms/image_transform.py","mode":"100644","sha":"f6c11fe496ceff4d926f0245b3286bfc463e281b","size":15955},{"path":"core/transforms/region_transform.py","mode":"100644","sha":"b8b975b889579cf3fbc4a1c350742eee09c2ef7c","size":4530},{"path":"core/transforms/video_transform.py","mode":"100644","sha":"889b12d0eece27ae5778e79c9e73524dfc65eda2","size":5534},{"path":"core/utils.py","mode":"100644","sha":"3b6baa5bad4d1cfa9e29b43d078b87f4dc1fa2b0","size":1062},{"path":"core/vision_encoder/__init__.py","mode":"100644","sha":"e69de29bb2d1d6434b8b29ae775ad8c2e48c5391","size":0},{"path":"core/vision_encoder/bpe_simple_vocab_16e6.txt.gz","mode":"100644","sha":"7b5088a527f720063f044eb928eee315f63b2fc0","size":1356917},{"path":"core/vision_encoder/config.py","mode":"100644","sha":"d814904602f1014b49b07f2208b96fa48c7d8ff5","size":5175},{"path":"core/vision_encoder/pe.py","mode":"100644","sha":"b190fe9660c2da5df5bada28f7dc4e87c627b4ab","size":24000},{"path":"core/vision_encoder/rope.py","mode":"100644","sha":"453da56c96ee2e0d2e83df34f69be84306c22619","size":10507},{"path":"core/vision_encoder/tokenizer.py","mode":"100644","sha":"e3a5547a8543ba7995b2201d0b2604295f965d8c","size":11525},{"path":"core/vision_encoder/transforms.py","mode":"100644","sha":"a84f2be4f62f629270863cc8c44c430f34165ad2","size":861},{"path":"core/vision_projector/__init__.py","mode":"100644","sha":"e69de29bb2d1d6434b8b29ae775ad8c2e48c5391","size":0},{"path":"core/vision_projector/base.py","mode":"100644","sha":"872bb83f9913ac04effd87d7a35942a64c470f0c","size":628},{"path":"core/vision_projector/mlp.py","mode":"100644","sha":"81639d3651a431a005b865e06731f839008e86c5","size":1982},{"path":"requirements.txt","mode":"100644","sha":"2ac27f8801b123e0b2d7a2a010484a730feb25cf","size":528},{"path":"setup.py","mode":"100644","sha":"3c4f09a101397153f40c8489fc8ebfe121de15aa","size":716}]}