spotify / flink
Duplication

Places in code with 6 or more lines that are exactly the same.

Intro
Learn more...
Duplication Overall
system16% (76,963 lines)
dependency graphs: 2D graph | 3D graph | 3D graph (with duplicates)...
Duplication per Extension
java14% (51,290 lines)
scala23% (20,648 lines)
xml45% (2,668 lines)
ftl43% (1,201 lines)
ts11% (452 lines)
py3% (346 lines)
less16% (184 lines)
html7% (89 lines)
pyx8% (73 lines)
clj<1% (12 lines)
Duplication per Component (primary)
flink-table20% (32,625 lines)
flink-core19% (8,531 lines)
flink-runtime8% (7,881 lines)
flink-connectors20% (6,153 lines)
flink-filesystems45% (4,790 lines)
flink-streaming-java14% (3,807 lines)
flink-libraries17% (3,367 lines)
flink-formats18% (2,396 lines)
flink-python8% (1,400 lines)
flink-optimizer14% (1,361 lines)
flink-java11% (1,044 lines)
flink-runtime-web10% (852 lines)
flink-state-backends8% (600 lines)
flink-scala11% (534 lines)
flink-streaming-scala25% (520 lines)
flink-clients6% (259 lines)
flink-queryable-state8% (156 lines)
flink-yarn3% (133 lines)
flink-scala-shell17% (100 lines)
flink-mesos3% (100 lines)
flink-kubernetes4% (97 lines)
flink-metrics2% (53 lines)
flink-ml-parent1% (44 lines)
flink-dist9% (38 lines)
flink-walkthroughs9% (26 lines)
flink-contrib9% (24 lines)
flink-quickstart60% (24 lines)
tools2% (18 lines)
flink-examples100% (18 lines)
flink-jepsen<1% (12 lines)
flink-external-resources0% (0 lines)
flink-container0% (0 lines)
flink-annotations0% (0 lines)

Duplication Between Components (50+ lines)

G flink-runtime flink-runtime flink-table flink-table flink-runtime--flink-table 1799 flink-streaming-java flink-streaming-java flink-runtime--flink-streaming-java 724 flink-state-backends flink-state-backends flink-runtime--flink-state-backends 327 flink-yarn flink-yarn flink-runtime--flink-yarn 130 flink-core flink-core flink-core--flink-runtime 1440 flink-core--flink-table 1053 flink-python flink-python flink-core--flink-python 380 flink-core--flink-streaming-java 210 flink-formats flink-formats flink-core--flink-formats 249 flink-libraries flink-libraries flink-core--flink-libraries 658 flink-java flink-java flink-core--flink-java 113 flink-connectors flink-connectors flink-connectors--flink-runtime 822 flink-connectors--flink-table 1229 flink-connectors--flink-core 783 flink-connectors--flink-python 204 flink-connectors--flink-streaming-java 306 flink-connectors--flink-formats 332 flink-connectors--flink-libraries 263 flink-mesos flink-mesos flink-connectors--flink-mesos 204 flink-connectors--flink-java 210 flink-ml-parent flink-ml-parent flink-connectors--flink-ml-parent 210 flink-python--flink-runtime 558 flink-python--flink-table 1181 flink-python--flink-streaming-java 100 flink-streaming-java--flink-table 1167 flink-formats--flink-runtime 674 flink-formats--flink-table 1022 flink-formats--flink-python 134 flink-formats--flink-streaming-java 214 flink-formats--flink-libraries 200 flink-formats--flink-mesos 108 flink-formats--flink-java 114 flink-formats--flink-ml-parent 114 flink-libraries--flink-runtime 617 flink-libraries--flink-table 863 flink-libraries--flink-python 104 flink-libraries--flink-streaming-java 203 flink-mesos--flink-runtime 713 flink-mesos--flink-table 654 flink-java--flink-runtime 596 flink-java--flink-table 660 flink-java--flink-streaming-java 248 flink-java--flink-libraries 86 flink-scala flink-scala flink-java--flink-scala 276 flink-ml-parent--flink-runtime 564 flink-ml-parent--flink-table 660 flink-runtime-web flink-runtime-web flink-runtime-web--flink-runtime 499 flink-kubernetes flink-kubernetes flink-kubernetes--flink-runtime 147 flink-kubernetes--flink-yarn 114 flink-queryable-state flink-queryable-state flink-queryable-state--flink-runtime 135

Download: SVG DOT (open online Graphviz editor)

Open 2D force graph... Open 3D force graph...

Show more details on duplication between components...
Longest Duplicates
The list of 50 longest duplicates.
See data for all 51,319 duplicates...
Size#FoldersFilesLinesCode
312 x 2 flink-table/flink-table-...flink/table/expressions
flink-table/flink-table-...flink/table/expressions
240:728 (68%)
241:729 (68%)
view
310 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
437:1017 (50%)
409:989 (59%)
view
186 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
45:304 (97%)
42:301 (98%)
view
186 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
42:392 (100%)
42:392 (100%)
view
149 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
1283:1665 (9%)
1154:1536 (11%)
view
146 x 2 flink-table/flink-table-...ink/table/planner/utils
flink-table/flink-table-...apache/flink/table/util
70:295 (97%)
70:295 (100%)
view
143 x 2 flink-table/flink-table-...le/planner/utils/python
flink-table/flink-table-...flink/table/util/python
266:474 (49%)
210:418 (55%)
view
141 x 2 flink-table/flink-table-...flink/table/expressions
flink-table/flink-table-...flink/table/expressions
40:236 (31%)
40:237 (31%)
view
125 x 2 flink-filesystems/flink-...aded/src/main/resources
flink-filesystems/flink-...main/resources/META-INF
939:1126 (6%)
829:1016 (8%)
view
120 x 2 flink-filesystems/flink-...aded/src/main/resources
flink-filesystems/flink-...main/resources/META-INF
1425:1612 (6%)
1128:1315 (7%)
view
109 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
96:233 (63%)
103:240 (62%)
view
107 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
1804:2005 (6%)
1572:1773 (8%)
view
101 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
2443:2678 (6%)
2154:2389 (7%)
view
93 x 2 flink-table/flink-sql-pa...c/main/codegen/includes
flink-table/flink-sql-pa...c/main/codegen/includes
876:971 (6%)
1223:1318 (7%)
view
89 x 2 flink-filesystems/flink-...aded/src/main/resources
flink-filesystems/flink-...main/resources/META-INF
1719:1855 (4%)
1494:1630 (5%)
view
88 x 2 flink-filesystems/flink-...aded/src/main/resources
flink-filesystems/flink-...main/resources/META-INF
2049:2177 (4%)
1825:1953 (5%)
view
88 x 2 flink-connectors/flink-c...eaming/connectors/kafka
flink-connectors/flink-c...eaming/connectors/kafka
1364:1517 (12%)
1620:1774 (10%)
view
78 x 2 flink-table/flink-table-...nner/plan/nodes/logical
flink-table/flink-table-...able/plan/nodes/logical
34:120 (100%)
33:119 (100%)
view
77 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
218:297 (22%)
224:303 (21%)
view
76 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
291:429 (4%)
270:408 (6%)
view
75 x 2 flink-connectors/flink-c...he/flink/connector/jdbc
flink-connectors/flink-c...nk/connector/jdbc/table
153:279 (37%)
111:230 (34%)
view
74 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
212:288 (21%)
224:300 (20%)
view
74 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
212:288 (21%)
218:294 (21%)
view
73 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
47:173 (92%)
41:167 (94%)
view
72 x 2 flink-libraries/flink-ge...ary/clustering/directed
flink-libraries/flink-ge...y/clustering/undirected
44:190 (100%)
44:190 (100%)
view
71 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
206:279 (21%)
218:291 (20%)
view
71 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
206:279 (21%)
224:297 (19%)
view
71 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
206:279 (21%)
212:285 (21%)
view
70 x 2 flink-formats/flink-orc-...apache/flink/orc/nohive
flink-formats/flink-orc/...apache/flink/orc/vector
117:200 (61%)
58:141 (87%)
view
69 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
2254:2437 (4%)
1967:2150 (5%)
view
68 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
200:270 (21%)
206:276 (20%)
view
68 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
200:270 (21%)
212:282 (20%)
view
68 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
200:270 (21%)
218:288 (19%)
view
68 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
200:270 (21%)
224:294 (18%)
view
67 x 2 flink-libraries/flink-ge...library/metric/directed
flink-libraries/flink-ge...brary/metric/undirected
236:358 (40%)
209:331 (46%)
view
66 x 2 flink-table/flink-table-...ble/planner/expressions
flink-table/flink-table-...flink/table/expressions
47:142 (90%)
43:137 (91%)
view
65 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
194:261 (21%)
200:267 (20%)
view
65 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
194:261 (21%)
212:279 (19%)
view
65 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
194:261 (21%)
206:273 (20%)
view
65 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
194:261 (21%)
224:291 (17%)
view
65 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
194:261 (21%)
218:285 (18%)
view
64 x 2 flink-filesystems/flink-...aded/src/main/resources
flink-filesystems/flink-...main/resources/META-INF
97:190 (3%)
106:199 (4%)
view
63 x 2 flink-table/flink-table-...le/planner/utils/python
flink-table/flink-table-...flink/table/util/python
154:233 (21%)
127:206 (24%)
view
62 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
188:252 (21%)
224:288 (17%)
view
62 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
188:252 (21%)
218:282 (17%)
view
62 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
290:400 (10%)
262:372 (11%)
view
62 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
188:252 (21%)
194:258 (20%)
view
62 x 2 flink-libraries/flink-ge...ary/clustering/directed
flink-libraries/flink-ge...y/clustering/undirected
42:178 (100%)
42:177 (100%)
view
62 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
188:252 (21%)
200:264 (19%)
view
62 x 2 flink-core/src/main/java...he/flink/api/java/tuple
flink-core/src/main/java...he/flink/api/java/tuple
188:252 (21%)
212:276 (18%)
view
Duplicated Units
The list of top 50 duplicated units.
See data for all 409 unit duplicates...
Size#FoldersFilesLinesCode
144 x 2 flink-table/flink-table-...le/planner/utils/python
flink-table/flink-table-...flink/table/util/python
279:432 
223:376 
view
83 x 2 flink-formats/flink-orc/...apache/flink/orc/vector
flink-formats/flink-orc-...apache/flink/orc/nohive
58:143 
117:202 
view
66 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
138:213 
135:210 
view
66 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
226:301 
223:298 
view
55 x 2 flink-runtime/src/main/j.../runtime/operators/sort
flink-runtime/src/main/j.../runtime/operators/sort
88:156 
89:157 
view
54 x 2 flink-table/flink-table-...ble/planner/expressions
flink-table/flink-table-...flink/table/expressions
89:157 
163:231 
view
52 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
51:117 
48:114 
view
47 x 2 flink-table/flink-table-...table/planner/typeutils
flink-table/flink-table-...e/flink/table/typeutils
100:149 
227:276 
view
44 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
47:98 
47:98 
view
43 x 2 flink-connectors/flink-c...nk/connector/jdbc/table
flink-connectors/flink-c...he/flink/connector/jdbc
166:211 
209:254 
view
40 x 2 flink-connectors/flink-c...ors/elasticsearch/table
flink-connectors/flink-c...ors/elasticsearch/table
110:151 
111:152 
view
34 x 2 flink-table/flink-table-...ble/planner/expressions
flink-table/flink-table-...flink/table/expressions
34:72 
53:91 
view
34 x 2 flink-table/flink-table-...ble/planner/expressions
flink-table/flink-table-...apache/flink/table/plan
36:76 
36:76 
view
31 x 2 flink-table/flink-table-...n/nodes/physical/stream
flink-table/flink-table-...e/plan/nodes/datastream
342:380 
282:320 
view
31 x 2 flink-connectors/flink-h.../api/java/hadoop/mapred
flink-connectors/flink-h...i/java/hadoop/mapreduce
207:254 
229:276 
view
29 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
355:390 
327:362 
view
28 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
2101:2136 
2388:2423 
view
27 x 2 flink-table/flink-table-...ble/planner/expressions
flink-table/flink-table-...flink/table/expressions
338:367 
785:814 
view
27 x 2 flink-optimizer/src/main...ink/optimizer/operators
flink-optimizer/src/main...ink/optimizer/operators
49:85 
53:89 
view
26 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
160:190 
167:197 
view
26 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
49:81 
49:81 
view
24 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
231:260 
210:239 
view
23 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
104:130 
111:137 
view
23 x 2 flink-table/flink-table-...ble/planner/expressions
flink-table/flink-table-...flink/table/expressions
77:105 
203:231 
view
22 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
132:158 
139:165 
view
22 x 2 flink-connectors/flink-c...nk/connector/jdbc/table
flink-connectors/flink-c...nk/connector/jdbc/table
208:232 
218:242 
view
21 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...table/plan/rules/common
232:255 
245:268 
view
21 x 2 flink-connectors/flink-c...ors/elasticsearch/table
flink-connectors/flink-c...ors/elasticsearch/table
47:70 
56:79 
view
21 x 3 flink-connectors/flink-c...eaming/connectors/kafka
flink-connectors/flink-c...eaming/connectors/kafka
flink-connectors/flink-c...eaming/connectors/kafka
55:78 
58:81 
58:81 
view
21 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
1700:1722 
1932:1954 
view
20 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
195:219 
174:198 
view
20 x 2 flink-table/flink-table-...k/table/planner/calcite
flink-table/flink-table-...che/flink/table/calcite
208:229 
145:166 
view
20 x 3 flink-connectors/flink-c...nnectors/elasticsearch7
flink-connectors/flink-c...nnectors/elasticsearch6
flink-connectors/flink-c...nnectors/elasticsearch5
96:119 
95:118 
99:122 
view
19 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
1164:1185 
998:1019 
view
19 x 2 flink-table/flink-table-...nner/plan/nodes/logical
flink-table/flink-table-...able/plan/nodes/logical
95:116 
94:115 
view
19 x 2 flink-table/flink-table-...ble/planner/expressions
flink-table/flink-table-...flink/table/expressions
45:67 
45:67 
view
19 x 2 flink-table/flink-table-...planner/functions/utils
flink-table/flink-table-...k/table/functions/utils
424:446 
212:234 
view
19 x 2 flink-connectors/flink-c...nk/connector/jdbc/table
flink-connectors/flink-c...he/flink/connector/jdbc
126:149 
169:192 
view
19 x 2 flink-filesystems/flink-.../org/apache/hadoop/conf
flink-filesystems/flink-.../org/apache/hadoop/conf
2270:2290 
2559:2579 
view
18 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...table/plan/rules/common
261:282 
274:295 
view
18 x 2 flink-table/flink-table-...e/planner/plan/metadata
flink-table/flink-table-...e/planner/plan/metadata
78:98 
168:188 
view
18 x 2 flink-connectors/flink-c...eaming/connectors/kafka
flink-connectors/flink-c...eaming/connectors/kafka
249:274 
295:321 
view
18 x 2 flink-connectors/flink-c...nnectors/kafka/internal
flink-connectors/flink-c...nnectors/kafka/internal
110:136 
110:136 
view
18 x 2 flink-connectors/flink-c.../connector/hbase/source
flink-connectors/flink-c.../connector/hbase/source
125:146 
127:148 
view
18 x 3 flink-runtime/src/main/j.../runtime/operators/hash
flink-runtime/src/main/j.../runtime/operators/hash
flink-runtime/src/main/j.../runtime/operators/hash
40:61 
40:61 
40:61 
view
17 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
676:694 
648:666 
view
17 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
767:785 
739:757 
view
17 x 2 flink-table/flink-table-...flink/table/data/binary
flink-table/flink-table-...link/table/runtime/util
988:1006 
960:978 
view
17 x 2 flink-table/flink-table-...table/runtime/hashtable
flink-runtime/src/main/j.../runtime/operators/hash
314:333 
1394:1413 
view
17 x 2 flink-table/flink-table-...nner/plan/rules/logical
flink-table/flink-table-...able/plan/rules/logical
61:81 
63:83 
view