Preview release 1.1.0 alpha 1
Pre-release
Pre-release
pkolaczk
released this
23 Sep 07:58
·
2864 commits
to master
since this release
Warning: This is a preview release - the API might change.
Version 1.1.0 is intended to be compatible with Spark 1.0.2 and Spark 1.1.x, as well as Cassandra 2.0 and Cassandra 2.1.
Changes from 1.0.0:
- Add an ./sbt/sbt script (like with spark) so people don't need to install sbt
- Replace internal spark Logging with own class (#245)
- Accept partition key predicates in CassandraRDD#where. (#37)
- Add indexedColumn to ColumnDef (#122)
- Upgrade Spark to version 1.0.2.
- Removed deprecated toArray, replaced with collect.
- Updated imports to org.apache.spark.streaming.receiver
and import org.apache.spark.streaming.receiver.ActorHelper - Updated streaming demo and spec for Spark 1.0.2 behavior compatibility
- Added new StreamingEvent types for Spark 1.0.2 Receiver readiness
- Added the following Spark Streaming dependencies to the demos module:
Kafka, Twitter, ZeroMQ - Added embedded Kafka and ZooKeeper servers for the Kafka Streaming demo
- keeping non private for user prototyping
- Added new Kafka Spark Streaming demo which reads from Kafka
and writes to Cassandra (Twitter and ZeroMQ are next) - Added new 'embedded' module
- Refactored the 'connector' module's IT SparkRepl, CassandraServer and CassandraServerRunner as
well as 'demos' EmbeddedKafka and EmbeddedZookeeper to the 'embedded' module. This allows the 'embedded'
module to be used as a dependency by the 'connector' IT tests, demos, and user local quick prototyping
without requiring a Spark and Cassandra Cluster, local or remote, to get started.
- Refactored the 'connector' module's IT SparkRepl, CassandraServer and CassandraServerRunner as