Categories
Misc

loading dataset from minIO S3 bucket for training.

I am trying to load TFRecords dataset from minIO S3 bucket and read them and use them for training on the go as done in this link: https://www.google.com/amp/s/blog.min.io/hyper-scale-machine-learning-with-minio-and-tensorflow/amp/

But when I do model.fit(), It gives following error: next(iter(training_mapped_ds)).

Traceback (most recent call last): File “/home/vishal/miniotf2.py”, line 281, in <module> batch =next(iter(mapped_ds)) File “/home/vishal/anaconda3/lib/python3.9/site-packages/tensorflow/python/data/ops/iterator_ops.py”, line 766, in __next_ return self._next_internal() File “/home/vishal/anaconda3/lib/python3.9/site-packages/tensorflow/python/data/ops/iterator_ops.py”, line 749, in _next_internal ret = gen_dataset_ops.iterator_get_next( File “/home/vishal/anaconda3/lib/python3.9/site-packages/tensorflow/python/ops/gen_dataset_ops.py”, line 3017, in iterator_get_next _ops.raise_from_not_ok_status(e, name) File “/home/vishal/anaconda3/lib/python3.9/site-packages/tensorflow/python/framework/ops.py”, line 7164, in raise_from_not_ok_status raise core._status_to_exception(e) from None # pylint: disable=protected-access tensorflow.python.framework.errors_impl.UnknownError: : curlCode: 35, SSL connect error [Op:IteratorGetNext]

submitted by /u/randomName123s
[visit reddit] [comments]

Leave a Reply

Your email address will not be published.