python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
How to flatten SCollection[SCollection[SomeType]] into SCollection[SomeType]
I'm using Beam (and Scio, though feel free to answer this question for PCollections too) to read from multiple tables in BigQuery. Because I'm reading multiple datasets from a dynamically generated li...
pavelmk
Votes: 0
Answers: 1
Python - Apache-beam outputs an empty file using dataflow runner, works fine with direct runner. Dataflow does not raise any errors
I've been trying to run this apache-beam script. This script runs nightly through an airflow DAG, and works perfectly fine that way so I'm (reasonably) confident that the script is correct. I think th...
Nyrb
Votes: 0
Answers: 0
Apache Beam - use output of one aggregation in another aggregation
I am new to Apache Beam, coming over from PySpark's dataframe API. I'm having trouble using the output of one beam calculation in another beam calculation. Basically, I want to perform an aggregation ...
alexvas
Votes: 0
Answers: 1
ReadFromKafka with python in apache-beam Unsupported signal: 2
I´ve been strugglin making this work, I know this is a cross-language transform and all of that and I installed the Java jdk on my pc (when I write java -version on cmd I get correct information and a...
Christian
Votes: 0
Answers: 1