spotify / DataflowJavaSDK

Duplication

Places in code with 6 or more lines that are exactly the same.

Longest Duplicates

The list of 50 longest duplicates.

See data for all 227 duplicates...

Size	#	Folders	Files	Lines	Code
20	x 2	sdk/src/main/java/com/go...dk/transforms/windowing sdk/src/main/java/com/go...dk/transforms/windowing	AfterProcessingTime.java AfterWatermark.java	97:128 (26%) 134:165 (7%)	view
20	x 2	sdk/src/main/java/com/go...ataflow/sdk/util/common sdk/src/main/java/com/go...ataflow/sdk/util/common	Counter.java Counter.java	383:403 (3%) 559:579 (3%)	view
20	x 2	sdk/src/main/java/com/go...dk/transforms/windowing sdk/src/main/java/com/go...dk/transforms/windowing	AfterProcessingTime.java AfterSynchronizedProcessingTime.java	97:128 (26%) 76:107 (31%)	view
20	x 2	sdk/src/main/java/com/go...dk/transforms/windowing sdk/src/main/java/com/go...dk/transforms/windowing	AfterSynchronizedProcessingTime.java AfterWatermark.java	76:107 (31%) 134:165 (7%)	view
17	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	PubsubReader.java UngroupedWindmillReader.java	73:92 (33%) 81:100 (25%)	view
16	x 2	sdk/src/main/java/com/go...ow/sdk/runners/dataflow sdk/src/main/java/com/go...ow/sdk/runners/dataflow	AvroIOTranslator.java TextIOTranslator.java	80:98 (28%) 85:104 (26%)	view
16	x 2	contrib/join-library/src...low/contrib/joinlibrary contrib/join-library/src...low/contrib/joinlibrary	Join.java Join.java	97:116 (18%) 150:169 (18%)	view
16	x 2	sdk/src/main/java/com/go...ataflow/sdk/util/common sdk/src/main/java/com/go...ataflow/sdk/util/common	Counter.java Counter.java	563:579 (2%) 878:894 (2%)	view
16	x 2	sdk/src/main/proto sdk/src/main/proto	proto proto2_coder_test_messages.proto windmill.proto	1:17 (45%) 1:17 (6%)	view
16	x 2	sdk/src/main/java/com/go...ataflow/sdk/util/common sdk/src/main/java/com/go...ataflow/sdk/util/common	Counter.java Counter.java	387:403 (2%) 878:894 (2%)	view
15	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AssignWindowsParDoFn.java ReifyTimestampAndWindowsParDoFn.java	58:78 (21%) 53:73 (25%)	view
14	x 2	sdk/src/main/java/com/google/cloud/dataflow/sdk/io sdk/src/main/java/com/google/cloud/dataflow/sdk/io	AvroIO.java TextIO.java	629:657 (6%) 665:694 (5%)	view
14	x 2	contrib/join-library/src...low/contrib/joinlibrary contrib/join-library/src...low/contrib/joinlibrary	Join.java Join.java	52:69 (16%) 101:118 (16%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AssignWindowsParDoFn.java NormalParDoFn.java	65:78 (20%) 77:90 (14%)	view
14	x 2	sdk/src/main/java/com/go...cloud/dataflow/sdk/util sdk/src/main/java/com/go...cloud/dataflow/sdk/util	ReduceFnContextFactory.java ReduceFnContextFactory.java	238:261 (6%) 333:356 (6%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AssignWindowsParDoFn.java CombineValuesFn.java	65:78 (20%) 83:96 (9%)	view
14	x 2	sdk/src/main/java/com/go...cloud/dataflow/sdk/util sdk/src/main/java/com/go...cloud/dataflow/sdk/util	ReduceFnContextFactory.java ReduceFnContextFactory.java	238:261 (6%) 280:303 (6%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	CombineValuesFn.java ReifyTimestampAndWindowsParDoFn.java	83:96 (9%) 60:73 (24%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AssignWindowsParDoFn.java CombineValuesFn.java	120:133 (20%) 157:170 (9%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AssignWindowsParDoFn.java GroupAlsoByWindowsParDoFn.java	120:133 (20%) 254:267 (8%)	view
14	x 2	sdk/src/main/java/com/go...cloud/dataflow/sdk/util sdk/src/main/java/com/go...cloud/dataflow/sdk/util	ReduceFnContextFactory.java ReduceFnContextFactory.java	280:303 (6%) 333:356 (6%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	CombineValuesFn.java GroupAlsoByWindowsParDoFn.java	157:170 (9%) 254:267 (8%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	CombineValuesFn.java NormalParDoFn.java	83:96 (9%) 77:90 (14%)	view
14	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	NormalParDoFn.java ReifyTimestampAndWindowsParDoFn.java	77:90 (14%) 60:73 (24%)	view
13	x 2	contrib/join-library/src...low/contrib/joinlibrary contrib/join-library/src...low/contrib/joinlibrary	Join.java Join.java	52:67 (15%) 154:169 (15%)	view
13	x 2	sdk/src/main/java/com/go...dataflow/sdk/transforms sdk/src/main/java/com/go...dataflow/sdk/transforms	DoFnReflector.java DoFnReflector.java	504:524 (3%) 563:583 (3%)	view
13	x 2	sdk/src/main/java/com/go...ataflow/sdk/util/common sdk/src/main/java/com/go...ataflow/sdk/util/common	Counter.java Counter.java	534:546 (2%) 849:861 (2%)	view
13	x 2	sdk/src/main/java/com/go...oud/dataflow/sdk/coders sdk/src/main/java/com/go...oud/dataflow/sdk/coders	BigEndianIntegerCoder.java VarIntCoder.java	59:83 (41%) 62:86 (40%)	view
13	x 2	sdk/src/main/java/com/go...cloud/dataflow/sdk/util sdk/src/main/java/com/go...cloud/dataflow/sdk/util	WindowedValue.java WindowedValue.java	233:250 (3%) 278:295 (3%)	view
12	x 2	sdk/src/main/java/com/go...cloud/dataflow/sdk/util sdk/src/main/java/com/go...cloud/dataflow/sdk/util	TriggerContextFactory.java TriggerContextFactory.java	285:302 (4%) 346:363 (4%)	view
12	x 2	sdk/src/main/java/com/go...cloud/dataflow/sdk/util sdk/src/main/java/com/go...cloud/dataflow/sdk/util	TriggerContextFactory.java TriggerContextFactory.java	346:363 (4%) 396:413 (4%)	view
12	x 2	sdk/src/main/java/com/go...dk/transforms/windowing sdk/src/main/java/com/go...dk/transforms/windowing	AfterProcessingTime.java AfterWatermark.java	66:87 (15%) 100:124 (4%)	view
12	x 2	sdk/src/main/java/com/go...dk/transforms/windowing sdk/src/main/java/com/go...dk/transforms/windowing	AfterProcessingTime.java AfterSynchronizedProcessingTime.java	66:87 (15%) 45:66 (18%)	view
12	x 2	sdk/src/main/java/com/google/cloud/dataflow/sdk/io sdk/src/main/java/com/google/cloud/dataflow/sdk/io	AvroIO.java AvroIO.java	314:329 (5%) 664:679 (5%)	view
12	x 2	sdk/src/main/java/com/go...cloud/dataflow/sdk/util sdk/src/main/java/com/go...cloud/dataflow/sdk/util	TriggerContextFactory.java TriggerContextFactory.java	285:302 (4%) 396:413 (4%)	view
12	x 2	sdk/src/main/java/com/go...oud/dataflow/sdk/coders sdk/src/main/java/com/go...oud/dataflow/sdk/coders	AvroCoder.java AvroCoder.java	459:474 (4%) 605:618 (4%)	view
12	x 2	sdk/src/main/java/com/go...dk/transforms/windowing sdk/src/main/java/com/go...dk/transforms/windowing	AfterSynchronizedProcessingTime.java AfterWatermark.java	45:66 (18%) 100:124 (4%)	view
11	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AssignWindowsParDoFn.java ReifyTimestampAndWindowsParDoFn.java	124:134 (15%) 103:113 (18%)	view
11	x 2	sdk/src/main/java/com/go...oud/dataflow/sdk/coders sdk/src/main/java/com/go...oud/dataflow/sdk/coders	BigEndianLongCoder.java VarLongCoder.java	66:83 (35%) 71:88 (33%)	view
10	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	DefaultParDoFnFactory.java ParDoFnFactory.java	51:60 (25%) 40:49 (76%)	view
10	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AvroReaderFactory.java UngroupedShuffleReaderFactory.java	41:50 (38%) 37:46 (50%)	view
10	x 2	sdk/src/main/java/com/go...dataflow/sdk/transforms sdk/src/main/java/com/go...dataflow/sdk/transforms	DoFn.java DoFnWithContext.java	399:408 (8%) 368:377 (19%)	view
10	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	CombineValuesFn.java ReifyTimestampAndWindowsParDoFn.java	161:170 (6%) 103:112 (17%)	view
10	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...dataflow/sdk/util/state	WindmillStateInternals.java MergedCombiningValue.java	473:485 (3%) 56:68 (16%)	view
10	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	ConcatReaderFactory.java UngroupedWindmillReader.java	67:76 (13%) 59:68 (14%)	view
10	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	GroupAlsoByWindowsParDoFn.java ReifyTimestampAndWindowsParDoFn.java	258:267 (6%) 103:112 (17%)	view
10	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	InMemoryReaderFactory.java TextReaderFactory.java	39:48 (62%) 47:56 (38%)	view
9	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	GroupingShuffleReaderFactory.java TextReaderFactory.java	40:48 (31%) 47:55 (34%)	view
9	x 2	sdk/src/main/java/com/go...ud/dataflow/sdk/testing sdk/src/main/java/com/go...ud/dataflow/sdk/testing	DataflowAssert.java DataflowAssert.java	220:233 (2%) 369:382 (2%)	view
9	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	BigQueryReaderFactory.java PartitioningShuffleReaderFactory.java	39:47 (30%) 40:48 (34%)	view

Duplicated Units

The list of top 8 duplicated units.

See data for all 8 unit duplicates...

Size	#	Folders	Files	Lines	Code
8	x 2	sdk/src/main/java/com/google/cloud/dataflow/sdk/io sdk/src/main/java/com/google/cloud/dataflow/sdk/io	BigQueryIO.java TextIO.java	462:471  321:330	view
8	x 2	sdk/src/main/java/com/google/cloud/dataflow/sdk/io sdk/src/main/java/com/google/cloud/dataflow/sdk/io	BigQueryIO.java TextIO.java	871:880  705:714	view
8	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AvroReaderFactory.java UngroupedShuffleReaderFactory.java	42:51  38:47	view
8	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	TextReaderFactory.java InMemoryReaderFactory.java	48:57  40:49	view
7	x 2	sdk/src/main/java/com/go...dataflow/sdk/util/state sdk/src/main/java/com/go...flow/sdk/runners/worker	MergedCombiningValue.java WindmillStateInternals.java	57:65  474:482	view
6	x 2	sdk/src/main/java/com/go...dataflow/sdk/util/state sdk/src/main/java/com/go...cloud/dataflow/sdk/util	InMemoryStateInternals.java ReduceFnRunner.java	101:108  561:568	view
6	x 2	sdk/src/main/java/com/go.../sdk/util/common/worker sdk/src/main/java/com/go.../sdk/util/common/worker	FlattenOperation.java ReceivingOperation.java	25:32  37:44	view
6	x 2	sdk/src/main/java/com/go...flow/sdk/runners/worker sdk/src/main/java/com/go...flow/sdk/runners/worker	AvroSinkFactory.java TextSinkFactory.java	39:46  36:43	view