Category "tensorflow-datasets"

tensorflow 2 use keras.sequence as data generator for training machine learning model with multiprocessing error

I would like to do a test about training a machine learning model on EC2 instance with only CPUs from jupyter notebook. The code is tensorflow 2.8. Based on the

What is image data layout used in DNN models?

RGB images can be stored in memory in different ways, e.g. see link below planar and interleaved: http://avitevet.com/uncategorized/when-to-use-it-interleaved-v

DatasetNotFoundError: Dataset smartwatch_gestures not found

I need to use the smartwatch_gestures from Tensorflow datasets and here is my code: pip install --upgrade tfds-nightly import tensorflow_datasets as tfds impor

How to attach or get filenames from MapDataset from image_dataset_from_directory() in Keras?

I am training convolutional autoencoder and I have this code for loading data (images): train_ds = tf.keras.preprocessing.image_dataset_from_directory( 'pat

TF pipeline to dynamically extract patches and flatten dataset

I was trying to train an autoencoder on image patches. My training data consists of single-channel images loaded into a numpy array with shape [10000, 256, 512,

How do I obtain URL to download the csv files of Tensorflow datasets?

In TensorFlow examples, I can see URLs to download the csv format of the dataset. For example, Iris- https://storage.googleapis.com/download.tensorflow.org/data

How to retrieve file paths from a tf.data.Dataset created with from_tensor_slices() and shuffled after every epoch

First of all, I would like to say that this is my first question in stackOverflow, so I hope that the question as a whole respects the rules. I realize that the

Create a Tensorflow Dataset from a Pandas data frame with numerous labels?

I am trying to load a pandas dataframe into a tensor Dataset. The columns are text[string] and labels[a list in string format] A row would look something like:

loading tensorflow dataset gives NonMatchingChecksumError

My goal is to use the following dataset from tensorflow-datasets for Machine Learning https://www.tensorflow.org/datasets/catalog/wider_face import tensorflow a

tf.data.Dataset, map functionality and random

Manipulating tf.data.Dataset I get a behavior, I am not able to understand the origin. I am manipulating a tf.data.Dataset a simple integer buffer where I want

Converting a tf.dataset to a PyTorch Dataset?

I'm working on this project where all the data comes preprocessed and ready as a tensorflow datasets which looks like this: <MapDataset shapes: {input_ids: (

TensorFlow: How do I generate a dataset from two arrays?

I've been trying to generate a custom dataset from two arrays. One with the shape (128,128,6) (satellite data with 6 channels), and the other with the shape (12

Tensorflow object detection "Use fn_output_signature instead" warning

I am following this tutorial to train my own models. https://tensorflow-object-detection-api-tutorial.readthedocs.io/en/latest/ I followed all the steps exactly

How to acquire tf.data.dataset's shape?

I know dataset has output_shapes, but it shows like below: data_set: DatasetV1Adapter shapes: {item_id_hist: (?, ?), tags: (?, ?), client_platform: (?,), en

how to get string value out of tf.tensor which dtype is string

I want to use tf.data.Dataset.list_files function to feed my datasets. But because the file is not image, I need to load it manually. The problem is tf.data.Dat

How to replace make_one_shot_iterator () from google machine learning crash course

I am following the Google Machine Learning Intensive Course. But it uses version 1.x of TensorFlow, so I was planning to change the exercises to be able to run

How to replace make_one_shot_iterator () from google machine learning crash course

I am following the Google Machine Learning Intensive Course. But it uses version 1.x of TensorFlow, so I was planning to change the exercises to be able to run

Using tf.data.Dataset as training input to Keras model NOT working

I have a simple code, which DOES work, for training a Keras model in Tensorflow using numpy arrays as features and labels. If I then wrap these numpy arrays usi

How to feed in a list of numpy arrays into a TensorFlow model?

I have a large list of numpy arrays that I want to feed into a TensorFlow model. I can not concatenate the lists into one due to RAM memory issues. Below, I hav

Using tf.keras.utils.image_dataset_from_directory with label list

I have list of labels corresponding numbers of files in directory example: [1,2,3] train_ds = tf.keras.utils.image_dataset_from_directory( train_path, label