twitter / elephant-bird
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system5% (625 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java5% (625 lines)
Duplication per Component (primary)
pig5% (152 lines)
core3% (145 lines)
cascading365% (110 lines)
cascading255% (110 lines)
rcfile7% (62 lines)
crunch12% (34 lines)
hadoop-compat6% (12 lines)
lucene0% (0 lines)
cascading-protobuf0% (0 lines)
pig-lucene0% (0 lines)
hive0% (0 lines)
mahout0% (0 lines)
repo0% (0 lines)

Duplication Between Components (50+ lines)

G cascading2 cascading2 cascading3 cascading3 cascading2--cascading3 200

Download: SVG DOT (open online Graphviz editor)

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 38 longest duplicates.
See data for all 38 duplicates...
Size#FoldersFilesLinesCode
28 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
21:72 (84%)
24:75 (84%)
view
15 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/util
pig/src/main/java/com/tw...r/elephantbird/pig/util
59:77 (32%)
84:102 (33%)
view
14 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
21:47 (73%)
24:50 (73%)
view
14 x 2 pig/src/main/java/com/tw.../elephantbird/pig/store
pig/src/main/java/com/tw.../elephantbird/pig/store
29:47 (70%)
29:47 (70%)
view
14 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
37:57 (22%)
40:60 (21%)
view
12 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/util
pig/src/main/java/com/tw...r/elephantbird/pig/util
54:70 (23%)
54:70 (23%)
view
10 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
53:67 (27%)
54:68 (27%)
view
10 x 2 crunch/src/main/java/com...ter/elephantbird/crunch
crunch/src/main/java/com...ter/elephantbird/crunch
37:49 (31%)
36:48 (31%)
view
10 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
25:40 (58%)
27:42 (58%)
view
9 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
25:39 (26%)
26:40 (28%)
view
9 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
64:77 (11%)
37:50 (22%)
view
9 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
43:55 (26%)
44:56 (28%)
view
9 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
37:50 (14%)
37:50 (22%)
view
9 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
37:50 (22%)
40:53 (13%)
view
8 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/load
pig/src/main/java/com/tw...r/elephantbird/pig/load
125:136 (12%)
170:187 (11%)
view
8 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
66:77 (9%)
72:83 (10%)
view
8 x 2 pig/src/main/java/com/tw.../elephantbird/pig/store
pig/src/main/java/com/tw.../elephantbird/pig/store
48:56 (28%)
47:55 (28%)
view
8 x 2 core/src/main/java/com/t...ntbird/mapreduce/output
core/src/main/java/com/t...ntbird/mapreduce/output
37:48 (25%)
61:72 (25%)
view
7 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
67:77 (11%)
80:90 (10%)
view
7 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/util
pig/src/main/java/com/tw...r/elephantbird/pig/util
251:257 (3%)
409:415 (3%)
view
7 x 2 rcfile/src/main/java/com...antbird/mapreduce/input
rcfile/src/main/java/com...antbird/mapreduce/input
111:118 (8%)
103:110 (8%)
view
7 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
25:35 (41%)
27:37 (41%)
view
7 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
36:44 (18%)
37:45 (18%)
view
7 x 2 crunch/src/main/java/com...ter/elephantbird/crunch
crunch/src/main/java/com...ter/elephantbird/crunch
24:32 (29%)
23:31 (29%)
view
6 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading2/src/main/java...tbird/cascading2/scheme
72:79 (18%)
47:54 (31%)
view
6 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/util
pig/src/main/java/com/tw...r/elephantbird/pig/util
46:54 (13%)
72:80 (13%)
view
6 x 2 core/src/main/java/com/t...ephantbird/mapred/input
core/src/main/java/com/t...mapreduce/input/combine
419:426 (2%)
166:173 (7%)
view
6 x 2 rcfile/src/main/java/com...antbird/mapreduce/input
rcfile/src/main/java/com...antbird/mapreduce/input
32:39 (17%)
32:39 (20%)
view
6 x 2 hadoop-compat/src/main/j...itter/elephantbird/util
hadoop-compat/src/main/j...itter/elephantbird/util
136:141 (3%)
157:162 (3%)
view
6 x 2 rcfile/src/main/java/com...ntbird/mapreduce/output
rcfile/src/main/java/com...ntbird/mapreduce/output
66:76 (10%)
74:84 (5%)
view
6 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/util
pig/src/main/java/com/tw...r/elephantbird/pig/util
23:30 (21%)
23:30 (30%)
view
6 x 2 cascading3/src/main/java...tbird/cascading3/scheme
cascading3/src/main/java...tbird/cascading3/scheme
75:82 (18%)
50:57 (31%)
view
6 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
102:119 (7%)
109:126 (7%)
view
6 x 2 rcfile/src/main/java/com...antbird/mapreduce/input
rcfile/src/main/java/com...antbird/mapreduce/input
62:71 (17%)
61:69 (20%)
view
6 x 2 core/src/main/java/com/t...antbird/mapreduce/input
core/src/main/java/com/t...antbird/mapreduce/input
79:87 (9%)
92:100 (9%)
view
6 x 2 rcfile/src/main/java/com...r/elephantbird/pig/load
rcfile/src/main/java/com...r/elephantbird/pig/load
47:56 (23%)
50:59 (21%)
view
6 x 2 core/src/main/java/com/t...ephantbird/mapreduce/io
core/src/main/java/com/t...ephantbird/mapreduce/io
22:29 (13%)
22:29 (13%)
view
6 x 2 cascading2/src/main/java...tbird/cascading2/scheme
cascading3/src/main/java...tbird/cascading3/scheme
37:46 (35%)
39:48 (35%)
view
Duplicated Units
The list of top 6 duplicated units.
See data for all 6 unit duplicates...
Size#FoldersFilesLinesCode
12 x 2 cascading3/src/main/java...tbird/cascading3/scheme
cascading2/src/main/java...tbird/cascading2/scheme
43:58 
42:57 
view
11 x 2 cascading3/src/main/java...tbird/cascading3/scheme
cascading2/src/main/java...tbird/cascading2/scheme
53:66 
52:65 
view
9 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/util
pig/src/main/java/com/tw...r/elephantbird/pig/util
85:95 
60:70 
view
9 x 2 pig/src/main/java/com/tw...r/elephantbird/pig/util
pig/src/main/java/com/tw...r/elephantbird/pig/util
58:68 
58:68 
view
7 x 2 pig/src/main/java/com/tw.../elephantbird/pig/store
pig/src/main/java/com/tw.../elephantbird/pig/store
36:44 
36:44 
view
6 x 2 cascading3/src/main/java...tbird/cascading3/scheme
cascading2/src/main/java...tbird/cascading2/scheme
36:43 
35:42 
view