Skip to content

Commit 16107cd

Browse files
selamw1selamw1
committed
“referece_tutorial_links_added”
1 parent fd8d211 commit 16107cd

File tree

2 files changed

+50
-39
lines changed

2 files changed

+50
-39
lines changed

‎docs/data_loaders_on_cpu_with_jax.ipynb

Lines changed: 42 additions & 37 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,13 @@
2424
"- [**Grain**](https://github.com/google/grain)\n",
2525
"- [**Hugging Face**](https://huggingface.co/docs/datasets/en/use_with_jax#data-loading)\n",
2626
"\n",
27-
"You'll see how to use each of these libraries to efficiently load data for a simple image classification task using the MNIST dataset."
27+
"In this tutorial, you'll learn how to efficiently load data using these libraries for a simple image classification task based on the MNIST dataset.\n",
28+
"\n",
29+
"Compared to GPU or multi-device setups, CPU-based data loading is straightforward as it avoids challenges like GPU memory management and data synchronization across devices. This makes it ideal for smaller-scale tasks or scenarios where data resides exclusively on the CPU.\n",
30+
"\n",
31+
"If you're looking for GPU-specific data loading advice, see [Data Loaders on GPU](https://jax-ai-stack.readthedocs.io/en/latest/data_loaders_on_gpu_with_jax.html).\n",
32+
"\n",
33+
"If you're looking for a multi-device data loading strategy, see [Data Loaders on Multi-Device Setups](https://jax-ai-stack.readthedocs.io/en/latest/data_loaders_for_multi_device_setups_with_jax.html)."
2834
]
2935
},
3036
{
@@ -40,7 +46,7 @@
4046
},
4147
{
4248
"cell_type": "code",
43-
"execution_count": 1,
49+
"execution_count": null,
4450
"metadata": {
4551
"id": "vqP6xyObC0_9"
4652
},
@@ -61,7 +67,7 @@
6167
},
6268
{
6369
"cell_type": "code",
64-
"execution_count": 2,
70+
"execution_count": null,
6571
"metadata": {
6672
"id": "tDJNQ6V-Dg5g"
6773
},
@@ -83,7 +89,7 @@
8389
},
8490
{
8591
"cell_type": "code",
86-
"execution_count": 3,
92+
"execution_count": null,
8793
"metadata": {
8894
"colab": {
8995
"base_uri": "https://localhost:8080/"
@@ -120,7 +126,7 @@
120126
},
121127
{
122128
"cell_type": "code",
123-
"execution_count": 4,
129+
"execution_count": null,
124130
"metadata": {
125131
"id": "qLNOSloFDka_"
126132
},
@@ -164,7 +170,7 @@
164170
},
165171
{
166172
"cell_type": "code",
167-
"execution_count": 5,
173+
"execution_count": null,
168174
"metadata": {
169175
"id": "bKIYPSkvD1QV"
170176
},
@@ -212,7 +218,7 @@
212218
},
213219
{
214220
"cell_type": "code",
215-
"execution_count": 6,
221+
"execution_count": null,
216222
"metadata": {
217223
"id": "sA0a06raEQfS"
218224
},
@@ -274,7 +280,7 @@
274280
},
275281
{
276282
"cell_type": "code",
277-
"execution_count": 7,
283+
"execution_count": null,
278284
"metadata": {
279285
"colab": {
280286
"base_uri": "https://localhost:8080/"
@@ -308,7 +314,7 @@
308314
},
309315
{
310316
"cell_type": "code",
311-
"execution_count": 8,
317+
"execution_count": null,
312318
"metadata": {
313319
"id": "kO5_WzwY59gE"
314320
},
@@ -322,7 +328,7 @@
322328
},
323329
{
324330
"cell_type": "code",
325-
"execution_count": 9,
331+
"execution_count": null,
326332
"metadata": {
327333
"id": "6f6qU8PCc143"
328334
},
@@ -356,7 +362,7 @@
356362
},
357363
{
358364
"cell_type": "code",
359-
"execution_count": 10,
365+
"execution_count": null,
360366
"metadata": {
361367
"colab": {
362368
"base_uri": "https://localhost:8080/"
@@ -486,7 +492,7 @@
486492
},
487493
{
488494
"cell_type": "code",
489-
"execution_count": 11,
495+
"execution_count": null,
490496
"metadata": {
491497
"id": "c9ZCJq_rzPck"
492498
},
@@ -509,7 +515,7 @@
509515
},
510516
{
511517
"cell_type": "code",
512-
"execution_count": 12,
518+
"execution_count": null,
513519
"metadata": {
514520
"id": "brlLG4SqGphm"
515521
},
@@ -522,7 +528,7 @@
522528
},
523529
{
524530
"cell_type": "code",
525-
"execution_count": 13,
531+
"execution_count": null,
526532
"metadata": {
527533
"colab": {
528534
"base_uri": "https://localhost:8080/"
@@ -560,7 +566,7 @@
560566
},
561567
{
562568
"cell_type": "code",
563-
"execution_count": 14,
569+
"execution_count": null,
564570
"metadata": {
565571
"id": "B-fES82EiL6Z"
566572
},
@@ -583,7 +589,7 @@
583589
},
584590
{
585591
"cell_type": "code",
586-
"execution_count": 15,
592+
"execution_count": null,
587593
"metadata": {
588594
"colab": {
589595
"base_uri": "https://localhost:8080/"
@@ -624,7 +630,7 @@
624630
},
625631
{
626632
"cell_type": "code",
627-
"execution_count": 16,
633+
"execution_count": null,
628634
"metadata": {
629635
"id": "sGaQAk1DHMUx"
630636
},
@@ -650,7 +656,7 @@
650656
},
651657
{
652658
"cell_type": "code",
653-
"execution_count": 17,
659+
"execution_count": null,
654660
"metadata": {
655661
"colab": {
656662
"base_uri": "https://localhost:8080/",
@@ -721,7 +727,7 @@
721727
},
722728
{
723729
"cell_type": "code",
724-
"execution_count": 18,
730+
"execution_count": null,
725731
"metadata": {
726732
"colab": {
727733
"base_uri": "https://localhost:8080/"
@@ -757,7 +763,7 @@
757763
},
758764
{
759765
"cell_type": "code",
760-
"execution_count": 19,
766+
"execution_count": null,
761767
"metadata": {
762768
"id": "vX59u8CqEf4J"
763769
},
@@ -785,7 +791,7 @@
785791
},
786792
{
787793
"cell_type": "code",
788-
"execution_count": 20,
794+
"execution_count": null,
789795
"metadata": {
790796
"colab": {
791797
"base_uri": "https://localhost:8080/"
@@ -835,7 +841,7 @@
835841
},
836842
{
837843
"cell_type": "code",
838-
"execution_count": 21,
844+
"execution_count": null,
839845
"metadata": {
840846
"colab": {
841847
"base_uri": "https://localhost:8080/"
@@ -887,7 +893,7 @@
887893
},
888894
{
889895
"cell_type": "code",
890-
"execution_count": 22,
896+
"execution_count": null,
891897
"metadata": {
892898
"id": "mS62eVL9Ifmz"
893899
},
@@ -911,7 +917,7 @@
911917
},
912918
{
913919
"cell_type": "code",
914-
"execution_count": 23,
920+
"execution_count": null,
915921
"metadata": {
916922
"id": "bnrhac5Hh7y1"
917923
},
@@ -945,7 +951,7 @@
945951
},
946952
{
947953
"cell_type": "code",
948-
"execution_count": 24,
954+
"execution_count": null,
949955
"metadata": {
950956
"id": "pN3oF7-ostGE"
951957
},
@@ -965,7 +971,7 @@
965971
},
966972
{
967973
"cell_type": "code",
968-
"execution_count": 25,
974+
"execution_count": null,
969975
"metadata": {
970976
"id": "f1VnTuX3u_kL"
971977
},
@@ -983,7 +989,7 @@
983989
},
984990
{
985991
"cell_type": "code",
986-
"execution_count": 26,
992+
"execution_count": null,
987993
"metadata": {
988994
"colab": {
989995
"base_uri": "https://localhost:8080/"
@@ -1019,7 +1025,7 @@
10191025
},
10201026
{
10211027
"cell_type": "code",
1022-
"execution_count": 27,
1028+
"execution_count": null,
10231029
"metadata": {
10241030
"id": "9RuFTcsCs2Ac"
10251031
},
@@ -1051,7 +1057,7 @@
10511057
},
10521058
{
10531059
"cell_type": "code",
1054-
"execution_count": 28,
1060+
"execution_count": null,
10551061
"metadata": {
10561062
"colab": {
10571063
"base_uri": "https://localhost:8080/"
@@ -1101,7 +1107,7 @@
11011107
},
11021108
{
11031109
"cell_type": "code",
1104-
"execution_count": 29,
1110+
"execution_count": null,
11051111
"metadata": {
11061112
"colab": {
11071113
"base_uri": "https://localhost:8080/"
@@ -1187,7 +1193,7 @@
11871193
},
11881194
{
11891195
"cell_type": "code",
1190-
"execution_count": 30,
1196+
"execution_count": null,
11911197
"metadata": {
11921198
"id": "8v1N59p76zn0"
11931199
},
@@ -1209,7 +1215,7 @@
12091215
},
12101216
{
12111217
"cell_type": "code",
1212-
"execution_count": 31,
1218+
"execution_count": null,
12131219
"metadata": {
12141220
"colab": {
12151221
"base_uri": "https://localhost:8080/",
@@ -1376,7 +1382,7 @@
13761382
},
13771383
{
13781384
"cell_type": "code",
1379-
"execution_count": 32,
1385+
"execution_count": null,
13801386
"metadata": {
13811387
"colab": {
13821388
"base_uri": "https://localhost:8080/"
@@ -1427,7 +1433,7 @@
14271433
},
14281434
{
14291435
"cell_type": "code",
1430-
"execution_count": 33,
1436+
"execution_count": null,
14311437
"metadata": {
14321438
"id": "-zLJhogj7RL-"
14331439
},
@@ -1453,7 +1459,7 @@
14531459
},
14541460
{
14551461
"cell_type": "code",
1456-
"execution_count": 34,
1462+
"execution_count": null,
14571463
"metadata": {
14581464
"colab": {
14591465
"base_uri": "https://localhost:8080/"
@@ -1489,13 +1495,12 @@
14891495
"source": [
14901496
"## Summary\n",
14911497
"\n",
1492-
"This notebook has guided you through efficient methods for loading data on a CPU when using JAX. You’ve learned how to leverage popular libraries such as PyTorch DataLoader, TensorFlow Datasets, Grain, and Hugging Face Datasets to streamline the data loading process for your machine learning tasks. Each of these methods offers unique advantages and considerations, allowing you to choose the best approach based on the specific needs of your project."
1498+
"This notebook has introduced efficient strategies for data loading on a CPU with JAX, demonstrating how to integrate popular libraries like PyTorch DataLoader, TensorFlow Datasets, Grain, and Hugging Face Datasets. Each library offers distinct advantages, enabling you to streamline the data loading process for machine learning tasks. By understanding the strengths of these methods, you can select the approach that best suits your project's specific requirements."
14931499
]
14941500
}
14951501
],
14961502
"metadata": {
14971503
"colab": {
1498-
"name": "data_loaders_on_cpu_with_jax.ipynb",
14991504
"provenance": []
15001505
},
15011506
"jupytext": {

‎docs/data_loaders_on_cpu_with_jax.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,13 @@ This tutorial explores different data loading strategies for using **JAX** on a
2626
- [**Grain**](https://github.com/google/grain)
2727
- [**Hugging Face**](https://huggingface.co/docs/datasets/en/use_with_jax#data-loading)
2828

29-
You'll see how to use each of these libraries to efficiently load data for a simple image classification task using the MNIST dataset.
29+
In this tutorial, you'll learn how to efficiently load data using these libraries for a simple image classification task based on the MNIST dataset.
30+
31+
Compared to GPU or multi-device setups, CPU-based data loading is straightforward as it avoids challenges like GPU memory management and data synchronization across devices. This makes it ideal for smaller-scale tasks or scenarios where data resides exclusively on the CPU.
32+
33+
If you're looking for GPU-specific data loading advice, see [Data Loaders on GPU](https://jax-ai-stack.readthedocs.io/en/latest/data_loaders_on_gpu_with_jax.html).
34+
35+
If you're looking for a multi-device data loading strategy, see [Data Loaders on Multi-Device Setups](https://jax-ai-stack.readthedocs.io/en/latest/data_loaders_for_multi_device_setups_with_jax.html).
3036

3137
+++ {"id": "pEsb135zE-Jo"}
3238

@@ -682,4 +688,4 @@ train_model(num_epochs, params, hf_training_generator)
682688

683689
## Summary
684690

685-
This notebook has guided you through efficient methods for loading data on a CPU when using JAX. You’ve learned how to leverage popular libraries such as PyTorch DataLoader, TensorFlow Datasets, Grain, and Hugging Face Datasets to streamline the data loading process for your machine learning tasks. Each of these methods offers unique advantages and considerations, allowing you to choose the best approach based on the specific needs of your project.
691+
This notebook has introduced efficient strategies for data loading on a CPU with JAX, demonstrating how to integrate popular libraries like PyTorch DataLoader, TensorFlow Datasets, Grain, and Hugging Face Datasets. Each library offers distinct advantages, enabling you to streamline the data loading process for machine learning tasks. By understanding the strengths of these methods, you can select the approach that best suits your project's specific requirements.

0 commit comments

Comments
 (0)