English summary of a Chinese forum discussion about enterprise AI landing, FDE field delivery and digital employees.
English summary of a Chinese forum discussion about enterprise AI landing, FDE field delivery and digital employees.
English summary of a Chinese forum discussion about enterprise AI landing, FDE field delivery and digital employees.
import org.
apache.
spark.
sql.
functions.
_ val df = spark.
read.
parquet("s3://enterprise AI landing/facts/day=*/part-*.
parquet") val scored = df .
withColumn("brand_norm", lower(trim(col("brand")))) .
groupBy("day","engine","brand_norm") .
agg( sum("mentions").
as("mentions"), countDistinct("query_id").
as("queries") ) .
withColumn("mentions_per_query", col("mentions") / col("queries")) scored.
write.