twitter / scalding
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system24% (9,769 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
scala27% (9,643 lines)
sbt10% (68 lines)
rb2% (32 lines)
java1% (26 lines)
Duplication per Component (primary)
scalding-core34% (5,457 lines)
scalding-base35% (3,318 lines)
scalding-serialization12% (395 lines)
scalding-thrift-macros46% (212 lines)
ROOT10% (68 lines)
scalding-beam7% (63 lines)
scalding-db7% (53 lines)
scalding-commons4% (45 lines)
scalding-parquet3% (41 lines)
scalding-spark3% (28 lines)
maple3% (26 lines)
scalding-parquet-scrooge4% (21 lines)
scripts2% (20 lines)
scalding-cats15% (16 lines)
scalding-json8% (6 lines)
scalding-avro0% (0 lines)
tutorial0% (0 lines)
scalding-dagon0% (0 lines)
scalding-hraven0% (0 lines)
scalding-quotation0% (0 lines)
scalding-args0% (0 lines)
project0% (0 lines)
scalding-date0% (0 lines)
scalding-hadoop-test0% (0 lines)
scalding-repl0% (0 lines)

Duplication Between Components (50+ lines)

G scalding-serialization scalding-serialization scalding-thrift-macros scalding-thrift-macros scalding-serialization--scalding-thrift-macros 420 scalding-core scalding-core scalding-core--scalding-serialization 154

Download: SVG DOT (open online Graphviz editor)

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 22,285 duplicates...
Size#FoldersFilesLinesCode
50 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 905:954 (2%)
1018:1067 (2%)
 view
46 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1554:1599 (2%)
1694:1739 (2%)
 view
46 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1025:1070 (2%)
1149:1194 (2%)
 view
46 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1284:1329 (2%)
1415:1460 (2%)
 view
46 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1152:1197 (2%)
1281:1326 (2%)
 view
46 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1418:1463 (2%)
1551:1596 (2%)
 view
43 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 912:954 (2%)
1149:1191 (2%)
 view
43 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1028:1070 (2%)
1281:1323 (2%)
 view
43 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1287:1329 (2%)
1551:1593 (2%)
 view
43 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1155:1197 (2%)
1415:1457 (2%)
 view
43 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1421:1463 (2%)
1694:1736 (2%)
 view
40 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1290:1329 (2%)
1694:1733 (2%)
 view
40 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 915:954 (2%)
1281:1320 (2%)
 view
40 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1031:1070 (2%)
1415:1454 (2%)
 view
40 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1158:1197 (2%)
1551:1590 (2%)
 view
39 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 807:845 (2%)
1150:1188 (2%)
 view
39 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 807:845 (2%)
913:951 (2%)
 view
39 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 807:845 (2%)
1026:1064 (2%)
 view
37 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1034:1070 (2%)
1551:1587 (2%)
 view
37 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 918:954 (2%)
1415:1451 (2%)
 view
37 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1161:1197 (2%)
1694:1730 (2%)
 view
37 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 809:845 (2%)
1281:1317 (2%)
 view
35 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 712:746 (2%)
808:842 (2%)
 view
35 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 712:746 (2%)
914:948 (2%)
 view
35 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 712:746 (2%)
1027:1061 (2%)
 view
35 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 712:746 (2%)
1151:1185 (2%)
 view
34 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 1037:1070 (2%)
1694:1727 (2%)
 view
34 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 921:954 (2%)
1551:1584 (2%)
 view
34 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 812:845 (2%)
1415:1448 (2%)
 view
34 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 713:746 (2%)
1281:1314 (2%)
 view
31 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 924:954 (1%)
1694:1724 (1%)
 view
31 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 815:845 (1%)
1551:1581 (1%)
 view
31 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 716:746 (1%)
1415:1445 (1%)
 view
30 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 627:656 (1%)
1153:1182 (1%)
 view
30 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 627:656 (1%)
1282:1311 (1%)
 view
30 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 627:656 (1%)
810:839 (1%)
 view
30 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 627:656 (1%)
714:743 (1%)
 view
30 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 627:656 (1%)
1029:1058 (1%)
 view
30 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 627:656 (1%)
916:945 (1%)
 view
29 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 477:505 (1%)
545:573 (1%)
 view
28 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 719:746 (1%)
1551:1578 (1%)
 view
28 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 818:845 (1%)
1694:1721 (1%)
 view
28 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 629:656 (1%)
1415:1442 (1%)
 view
27 x 2 scalding-serialization/s...l/ordered_serialization
scalding-thrift-macros/s...l/ordered_serialization
 304:339 (11%)
325:360 (10%)
 view
26 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 551:576 (1%)
1283:1308 (1%)
 view
26 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 551:576 (1%)
1154:1179 (1%)
 view
26 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 551:576 (1%)
917:942 (1%)
 view
26 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 551:576 (1%)
1030:1055 (1%)
 view
26 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 551:576 (1%)
715:740 (1%)
 view
26 x 2 scalding-base/src/main/s.../twitter/scalding/typed
scalding-base/src/main/s.../twitter/scalding/typed
 551:576 (1%)
811:836 (1%)
 view
Duplicated Units
The list of top 3 duplicated units.
See data for all 3 unit duplicates...
Size#FoldersFilesLinesCode
15 x 2 scalding-beam/src/main/s...r/scalding/beam_backend
scalding-core/src/main/s...typed/cascading_backend
 138:156 
488:507 
 view
14 x 2 scalding-core/src/main/s...er/scalding/macros/impl
scalding-db/src/main/sca...scalding/db/macros/impl
 41:58 
38:56 
 view
11 x 2 maple/src/main/java/com/twitter/maple/tap
maple/src/main/java/com/twitter/maple/tap
 19:32 
30:43 
 view