Skip to content

Preview release 1.1.0 alpha 1

Pre-release
Pre-release
Compare
Choose a tag to compare
@pkolaczk pkolaczk released this 23 Sep 07:58
· 2864 commits to master since this release

Warning: This is a preview release - the API might change.

Version 1.1.0 is intended to be compatible with Spark 1.0.2 and Spark 1.1.x, as well as Cassandra 2.0 and Cassandra 2.1.

Changes from 1.0.0:

  • Add an ./sbt/sbt script (like with spark) so people don't need to install sbt
  • Replace internal spark Logging with own class (#245)
  • Accept partition key predicates in CassandraRDD#where. (#37)
  • Add indexedColumn to ColumnDef (#122)
  • Upgrade Spark to version 1.0.2.
  • Removed deprecated toArray, replaced with collect.
  • Updated imports to org.apache.spark.streaming.receiver
    and import org.apache.spark.streaming.receiver.ActorHelper
  • Updated streaming demo and spec for Spark 1.0.2 behavior compatibility
  • Added new StreamingEvent types for Spark 1.0.2 Receiver readiness
  • Added the following Spark Streaming dependencies to the demos module:
    Kafka, Twitter, ZeroMQ
  • Added embedded Kafka and ZooKeeper servers for the Kafka Streaming demo
    • keeping non private for user prototyping
  • Added new Kafka Spark Streaming demo which reads from Kafka
    and writes to Cassandra (Twitter and ZeroMQ are next)
  • Added new 'embedded' module
    • Refactored the 'connector' module's IT SparkRepl, CassandraServer and CassandraServerRunner as
      well as 'demos' EmbeddedKafka and EmbeddedZookeeper to the 'embedded' module. This allows the 'embedded'
      module to be used as a dependency by the 'connector' IT tests, demos, and user local quick prototyping
      without requiring a Spark and Cassandra Cluster, local or remote, to get started.