Release Notes - Giraph (Retired) - Version 1.2.0 - HTML format

Bug

  • [GIRAPH-967] - GIRAPH-931 (Strongly Connected Components) bug fix
  • [GIRAPH-972] - Race condition in checkpointing
  • [GIRAPH-973] - Edge trimming no longer works before superstep 0
  • [GIRAPH-977] - useMessageSizeEncoding is broken
  • [GIRAPH-978] - Giraph-Debugger Test Graphs not working
  • [GIRAPH-983] - Remove checkpoint related error messages from console
  • [GIRAPH-992] - Zookeeper logs have too many NodeExists exceptions
  • [GIRAPH-1009] - Spammy 'lost reservation' messages from ZooKeeper in workers' log at the end of the computation.
  • [GIRAPH-1015] - Support vertex combiner in TestGraph
  • [GIRAPH-1017] - Add support for ImmutableMap in Kryo
  • [GIRAPH-1020] - TaskInfo equality condition
  • [GIRAPH-1024] - mvn release:prepare not committing changes to pom.xml
  • [GIRAPH-1026] - New Out-of-core mechanism does not work
  • [GIRAPH-1028] - BasicSet doesn't support large collections
  • [GIRAPH-1036] - Allow mappers to fail early on exceptions
  • [GIRAPH-1039] - Fix stopping jmap histo thread
  • [GIRAPH-1052] - Fix makeSymmetricUnweighted
  • [GIRAPH-1055] - Javadoc fails build with Java 8
  • [GIRAPH-1058] - Fix connection retry logic
  • [GIRAPH-1064] - Reconnect JobProgressTracker
  • [GIRAPH-1069] - Race condition in all *ConfOption classes
  • [GIRAPH-1070] - Comparators in PartitionUtils can overflow
  • [GIRAPH-1075] - UnsafeByteArrayOutputStream silently writes long UTFs incorrectly
  • [GIRAPH-1076] - Race condition in FileTxnSnapLog
  • [GIRAPH-1077] - Jobs getting stuck after channel failure
  • [GIRAPH-1081] - Fix a bug in internal out-of-core infra: multithreaded accesses to buffers
  • [GIRAPH-1083] - Make sure we fail after exception in ooc-io thread happens
  • [GIRAPH-1091] - Fix SimpleRangePartitionFactoryTest
  • [GIRAPH-1092] - TestCollections.testLargeBasicList fails with OOM
  • [GIRAPH-1095] - Performance regression after GIRAPH-1068
  • [GIRAPH-1097] - Fix TestOutOfCore.testOutOfCoreLocalDiskAccessor
  • [GIRAPH-1098] - Job may get stuck if zookeeper port fixed and is in use
  • [GIRAPH-1127] - Giraph does not build with Java 8 because of obsolete findbugs
  • [GIRAPH-1187] - NPE in worker GC listener

New Feature

  • [GIRAPH-966] - Add a way to ignore some thread exceptions
  • [GIRAPH-971] - Simple Giraph Oozie Action module
  • [GIRAPH-1004] - Allow changing hadoop output format
  • [GIRAPH-1022] - Out-of-core mechanism for input superstep and graph data
  • [GIRAPH-1023] - Adding out-of-core messages to the newly added adaptive out-of-core mechanism
  • [GIRAPH-1046] - Add a way to synchronize full GC calls across workers
  • [GIRAPH-1048] - Redesign of out-of-core mechanism (first patch -- out-of-core mechanism keeping fixed number of partitions in memory)
  • [GIRAPH-1050] - Add MapperObserver
  • [GIRAPH-1051] - Allow changing class loader in Kryo
  • [GIRAPH-1053] - Log exceptions to command line
  • [GIRAPH-1061] - Add Connected Components block factory
  • [GIRAPH-1062] - Page rank in Blocks&Pieces
  • [GIRAPH-1063] - Make primitive type generated fixed capacity min heaps
  • [GIRAPH-1066] - Functional adaptive out-of-core mechanism
  • [GIRAPH-1079] - Add triangle counting example
  • [GIRAPH-1080] - Add FacebookConfiguration
  • [GIRAPH-1085] - Add InMemoryDataAccessor

Improvement

  • [GIRAPH-965] - Improving and adding reducers
  • [GIRAPH-975] - In-proc ZooKeeper server with Master process
  • [GIRAPH-976] - More command line logging
  • [GIRAPH-979] - Add type of input to 'missing input' error message
  • [GIRAPH-980] - Way to disable checkpoints for particular job and on particular supersteps
  • [GIRAPH-985] - Add more metrics
  • [GIRAPH-986] - Add more stuff to TypeOps
  • [GIRAPH-987] - Improve naming for ReduceOperation
  • [GIRAPH-998] - Close writers in parallel
  • [GIRAPH-1002] - Support better message config for Giraph
  • [GIRAPH-1005] - Reorder MessageEncodeAndStoreType
  • [GIRAPH-1008] - Create Computation per thread instead of per partition
  • [GIRAPH-1010] - Add utilities to allow Kryo to serialize objects
  • [GIRAPH-1011] - Update checkstyle to newest version
  • [GIRAPH-1014] - Decrease number of nifty threads created
  • [GIRAPH-1018] - Improving PartitionStore API to better match its expected behaviour
  • [GIRAPH-1019] - Optimizing and debugging vertex mutation
  • [GIRAPH-1021] - Missing progress report for graph mutations
  • [GIRAPH-1025] - Flow-control mechanism improving out-of-core feature
  • [GIRAPH-1027] - Improve flow-control on sender side
  • [GIRAPH-1031] - Need a callback that will get triggered when job actually starts
  • [GIRAPH-1033] - Remove zookeeper from input splits handling
  • [GIRAPH-1035] - Make sure we are able to use all compute threads
  • [GIRAPH-1044] - Update book info in the User Docs / Related Literature page of the site
  • [GIRAPH-1047] - Increase info-logging while waiting for straggler workers
  • [GIRAPH-1049] - Optimizing LocalBlockRunner
  • [GIRAPH-1054] - Separate ThriftService from JobProgressTrackerService on the client
  • [GIRAPH-1056] - Setting auto-read in Netty to false
  • [GIRAPH-1057] - Decoupling NettyClient from control flow policy
  • [GIRAPH-1060] - Add combiner to connected components
  • [GIRAPH-1065] - Allow extending JobProgressTrackerService
  • [GIRAPH-1067] - Out-of-core message mechanism needs clean up
  • [GIRAPH-1072] - Improve metrics reported in out-of-core computation
  • [GIRAPH-1073] - Decouple out-of-core persistence infrastructure from out-of-core computation
  • [GIRAPH-1082] - Remove limit on the number of partitions
  • [GIRAPH-1089] - In fixed out-of-core policy the definition of in-memory partition is not clear
  • [GIRAPH-1105] - Fix number of open requests in FacebookConfiguration

Wish

Task

  • [GIRAPH-990] - Current trunk will build for hadoop 1.2.0 not 0.20.203 as stated by documentation
  • [GIRAPH-996] - Large requests degrade performance. Print out warnings.
  • [GIRAPH-997] - Upgrade findbugs to 3.0.0
  • [GIRAPH-1068] - Make Zookeeper accept 0 as a port number and let it choose any available free port

Edit/Copy Release Notes

The text area below allows the project release notes to be edited and copied to another document.