python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - tfx

Add reserved tokens to `tft.vocabulary`

I would like to append words to the vocabulary created by tft.vocabulary that are not a part of the training samples (i.e. <mask> and <pad> tokens). I see in the docs that the tft.vocabula...
test-img

Zach Robertson

python

tensorflow

tfx

mlops

tensorflow-transform

Votes: 0

Answers: 1

Latest Answer

What is it that you're trying to achieve? I don't think that key_fn is related as it only affects the ordering of the vocabulary (and top k when provided) Could you compute the vocabulary after append...
test-img

Zohar

What does DataAccessor do in tfx?

I'm reading the tfx tutorials, which all uses the DataAccessor to load data. The code looks something like this: return data_accessor.tf_dataset_factory( file_pattern, tfxio.TensorFlowDa...
test-img

bli00

tensorflow

tensorflow-datasets

tfx

Votes: 0

Answers: 1

Latest Answer

Looking through the documentations, DataAccessor seems to be a utility wrapper around a tf.data.Dataset factory. The object that is returned is an instance of tf.data.Dataset - so any subsequent metho...
test-img

Manish Dash

join datasets with tfx tensorflow transform

I am trying to replicate some data preprocessing that I have done in pandas into tensorflow transform. I have a few CSV files, which I joined and aggregated with pandas to produce a training dataset. ...
test-img

DarioB

apache-beam

tfx

tensorflow-transform

Votes: 0

Answers: 1

Latest Answer

You can use the Beam Dataframes API to do the join and other preprocessing exactly as you would have in Pandas. You can then use to_pcollection to get a PCollection that you can pass directly to your ...
test-img

robertwb

Is there an implemented way to use a kubeflow pipeline&#39;s output outside the pipeline?

I'm using local kubeflow pipelines for building a continuous machine learning test project. I have one pipeline that preprocess the data using TFX, and it saves the outputs automatically to minio. Out...
test-img

AnoderPersona

python

minio

kubeflow

kubeflow-pipelines

tfx

Votes: 0

Answers: 1

Latest Answer

You can get that information like this: https://github.com/kubeflow/pipelines/issues/4327#issuecomment-687255001 component_name: This can be checked in the yaml definition of the pipeline, under templ...
test-img

augustoamerico

Posts

Questions

Blogs

Jobs