duplicated block id: 1 size: 44 cleaned lines of code in 3 files: - follow-recommendations-service/common/src/main/scala/com/twitter/follow_recommendations/common/feature_hydration/sources/FeatureStoreGizmoduckSource.scala (100:148) - follow-recommendations-service/common/src/main/scala/com/twitter/follow_recommendations/common/feature_hydration/sources/FeatureStoreUserMetricCountsSource.scala (100:148) - follow-recommendations-service/common/src/main/scala/com/twitter/follow_recommendations/common/feature_hydration/sources/FeatureStoreTimelinesAuthorSource.scala (100:148) duplicated block id: 2 size: 40 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/hose/common/UnifiedGraphWriter.scala (88:131) - src/scala/com/twitter/recos/hose/common/UnifiedGraphWriterMulti.scala (94:137) duplicated block id: 3 size: 36 cleaned lines of code in 2 files: - twml/libtwml/src/lib/HashedDataRecord.cpp (14:51) - twml/libtwml/src/lib/DataRecord.cpp (14:51) duplicated block id: 4 size: 26 cleaned lines of code in 2 files: - twml/libtwml/src/ops/hashed_data_record.cpp (45:79) - twml/libtwml/src/ops/batch_prediction_request_v2.cpp (15:50) duplicated block id: 5 size: 23 cleaned lines of code in 2 files: - visibilitylib/src/main/scala/com/twitter/visibility/interfaces/search/SearchVisibilityLibrary.scala (427:452) - visibilitylib/src/main/scala/com/twitter/visibility/interfaces/blender/BlenderVisibilityLibrary.scala (377:402) duplicated block id: 6 size: 23 cleaned lines of code in 2 files: - recos-injector/server/src/main/scala/com/twitter/recosinjector/edges/TweetEventToUserTweetGraphBuilder.scala (43:69) - recos-injector/server/src/main/scala/com/twitter/recosinjector/edges/TweetEventToUserTweetEntityGraphBuilder.scala (115:141) duplicated block id: 7 size: 21 cleaned lines of code in 3 files: - src/scala/com/twitter/simclusters_v2/scalding/embedding/producer/AggregatableLogFavBasedProducerEmbeddings.scala (251:274) - src/scala/com/twitter/simclusters_v2/scalding/embedding/producer/AggregatableFollowBasedProducerEmbeddings.scala (119:142) - src/scala/com/twitter/simclusters_v2/scalding/embedding/producer/AggregatableFavBasedProducerEmbeddings.scala (163:186) duplicated block id: 8 size: 20 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/util/SampleLHSUsersUtil.scala (11:34) - src/scala/com/twitter/recos/user_tweet_graph/util/SampleLHSUsersUtil.scala (11:34) duplicated block id: 9 size: 19 cleaned lines of code in 2 files: - src/java/com/twitter/search/common/converter/earlybird/BasicIndexingConverter.java (93:118) - src/java/com/twitter/search/common/converter/earlybird/CombinedIndexingConverter.java (44:69) duplicated block id: 10 size: 19 cleaned lines of code in 2 files: - src/scala/com/twitter/simclusters_v2/scalding/embedding/common/ExternalDataSources.scala (405:425) - src/scala/com/twitter/simclusters_v2/scalding/UserUserNormalizedGraph.scala (50:70) duplicated block id: 11 size: 18 cleaned lines of code in 2 files: - twml/libtwml/src/ops/hashed_data_record.cpp (427:451) - twml/libtwml/src/ops/data_record.cpp (695:719) duplicated block id: 12 size: 17 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/store/UserRecentFollowersStore.scala (19:40) - src/scala/com/twitter/recos/user_tweet_graph/store/UserRecentFollowersStore.scala (19:40) duplicated block id: 13 size: 16 cleaned lines of code in 2 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/SkitTopicTweetSimilarityEngine.scala (85:102) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/SkitHighPrecisionTopicTweetSimilarityEngine.scala (80:97) duplicated block id: 14 size: 16 cleaned lines of code in 2 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/filter/PreRankFilterRunner.scala (81:98) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/filter/UtegFilterRunner.scala (78:95) duplicated block id: 15 size: 16 cleaned lines of code in 2 files: - src/scala/com/twitter/simclusters_v2/scalding/embedding/tfg/TfgBasedTopicEmbeddingsBaseApp.scala (80:97) - src/scala/com/twitter/simclusters_v2/scalding/embedding/tfg/InferredLanguageTfgBasedTopicEmbeddingsBaseApp.scala (120:137) duplicated block id: 16 size: 15 cleaned lines of code in 2 files: - twml/libtwml/src/ops/hashed_data_record.cpp (473:491) - twml/libtwml/src/ops/data_record.cpp (741:759) duplicated block id: 17 size: 15 cleaned lines of code in 3 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/candidate_generation/RelatedVideoTweetCandidateGenerator.scala (117:138) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/candidate_generation/RelatedTweetCandidateGenerator.scala (134:155) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/candidate_generation/CandidateSourcesRouter.scala (442:462) duplicated block id: 18 size: 15 cleaned lines of code in 2 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/TweetBasedUnifiedSimilarityEngine.scala (392:410) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/ProducerBasedUnifiedSimilarityEngine.scala (315:333) duplicated block id: 19 size: 14 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/Main.scala (91:106) - src/scala/com/twitter/recos/user_tweet_graph/Main.scala (91:106) duplicated block id: 20 size: 13 cleaned lines of code in 2 files: - pushservice/src/main/scala/com/twitter/frigate/pushservice/model/ibis/MagicFanoutNewsEventIbis2Hydrator.scala (32:46) - pushservice/src/main/scala/com/twitter/frigate/pushservice/model/ibis/MagicFanoutSportsEventIbis2Hydrator.scala (28:42) duplicated block id: 21 size: 13 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_tweet_entity_graph/UserTweetEdgeTypeMask.scala (80:94) - src/scala/com/twitter/recos/user_tweet_graph/util/UserTweetEdgeTypeMask.scala (62:76) duplicated block id: 22 size: 12 cleaned lines of code in 2 files: - timelines/data_processing/ml_util/aggregation_framework/metrics/LastResetMetric.scala (36:50) - timelines/data_processing/ml_util/aggregation_framework/metrics/CountMetric.scala (14:28) duplicated block id: 23 size: 12 cleaned lines of code in 2 files: - home-mixer/server/src/main/scala/com/twitter/home_mixer/product/scored_tweets/filter/ScoredTweetsSocialContextFilter.scala (45:60) - home-mixer/server/src/main/scala/com/twitter/home_mixer/product/for_you/filter/SocialContextFilter.scala (60:75) duplicated block id: 24 size: 11 cleaned lines of code in 2 files: - pushservice/src/main/scala/com/twitter/frigate/pushservice/predicate/PredicatesForCandidate.scala (513:525) - pushservice/src/main/scala/com/twitter/frigate/pushservice/predicate/TargetPredicates.scala (43:55) duplicated block id: 25 size: 11 cleaned lines of code in 2 files: - unified_user_actions/service/src/main/scala/com/twitter/unified_user_actions/service/module/KafkaProcessorRekeyUuaIesourceModule.scala (103:121) - unified_user_actions/service/src/main/scala/com/twitter/unified_user_actions/service/module/KafkaProcessorRekeyUuaModule.scala (100:118) duplicated block id: 26 size: 11 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/util/GetRelatedTweetCandidatesUtil.scala (43:55) - src/scala/com/twitter/recos/user_tweet_graph/util/GetRelatedTweetCandidatesUtil.scala (43:55) duplicated block id: 27 size: 10 cleaned lines of code in 4 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/module/thrift_client/UserVideoGraphClientModule.scala (32:45) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/module/thrift_client/UserTweetGraphClientModule.scala (29:42) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/module/thrift_client/UserTweetGraphPlusClientModule.scala (32:45) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/module/thrift_client/UserTweetEntityGraphClientModule.scala (29:42) duplicated block id: 28 size: 10 cleaned lines of code in 2 files: - recos-injector/server/src/main/scala/com/twitter/recosinjector/edges/TweetEventToUserTweetGraphBuilder.scala (27:38) - recos-injector/server/src/main/scala/com/twitter/recosinjector/edges/TweetEventToUserTweetEntityGraphBuilder.scala (37:48) duplicated block id: 29 size: 10 cleaned lines of code in 2 files: - tweetypie/server/src/main/scala/com/twitter/tweetypie/service/observer/GetDeletedTweetsObserver.scala (12:24) - tweetypie/server/src/main/scala/com/twitter/tweetypie/service/observer/GetTweetCountsObserver.scala (13:25) duplicated block id: 30 size: 10 cleaned lines of code in 3 files: - src/scala/com/twitter/simclusters_v2/scalding/embedding/producer/AggregatableLogFavBasedProducerEmbeddings.scala (276:287) - src/scala/com/twitter/simclusters_v2/scalding/embedding/producer/AggregatableFollowBasedProducerEmbeddings.scala (144:155) - src/scala/com/twitter/simclusters_v2/scalding/embedding/producer/AggregatableFavBasedProducerEmbeddings.scala (188:199) duplicated block id: 31 size: 10 cleaned lines of code in 2 files: - src/scala/com/twitter/simclusters_v2/scalding/embedding/common/ExternalDataSources.scala (524:535) - src/scala/com/twitter/simclusters_v2/scio/common/ExternalDataSources.scala (288:299) duplicated block id: 32 size: 10 cleaned lines of code in 2 files: - src/scala/com/twitter/simclusters_v2/scalding/mbcg/UserEmbeddingGenerationJob.scala (66:77) - src/scala/com/twitter/simclusters_v2/scalding/mbcg/TweetEmbeddingGenerationJob.scala (82:93) duplicated block id: 33 size: 10 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/UserVideoGraph.scala (48:59) - src/scala/com/twitter/recos/user_tweet_graph/UserTweetGraph.scala (65:76) duplicated block id: 34 size: 10 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/UserVideoGraph.scala (61:72) - src/scala/com/twitter/recos/user_tweet_graph/UserTweetGraph.scala (78:89) duplicated block id: 35 size: 9 cleaned lines of code in 2 files: - product-mixer/core/src/main/scala/com/twitter/product_mixer/core/pipeline/PipelineBuilder.scala (169:180) - product-mixer/core/src/main/scala/com/twitter/product_mixer/core/pipeline/NewPipelineArrowBuilder.scala (116:127) duplicated block id: 36 size: 9 cleaned lines of code in 2 files: - visibilitylib/src/main/scala/com/twitter/visibility/interfaces/search/SearchVisibilityLibrary.scala (454:465) - visibilitylib/src/main/scala/com/twitter/visibility/interfaces/blender/BlenderVisibilityLibrary.scala (404:415) duplicated block id: 37 size: 9 cleaned lines of code in 2 files: - visibilitylib/src/main/scala/com/twitter/visibility/interfaces/tweets/TweetVisibilityLibrary.scala (410:420) - visibilitylib/src/main/scala/com/twitter/visibility/interfaces/conversations/TimelineConversationsVisibilityLibrary.scala (249:259) duplicated block id: 38 size: 9 cleaned lines of code in 2 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/TwhinCollabFilterSimilarityEngine.scala (61:71) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/DiffusionBasedSimilarityEngine.scala (62:72) duplicated block id: 39 size: 9 cleaned lines of code in 2 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/TweetBasedUserTweetGraphSimilarityEngine.scala (132:142) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/TweetBasedUserVideoGraphSimilarityEngine.scala (133:143) duplicated block id: 40 size: 9 cleaned lines of code in 2 files: - timelines/data_processing/ml_util/aggregation_framework/metrics/MaxMetric.scala (17:27) - timelines/data_processing/ml_util/aggregation_framework/metrics/LatestMetric.scala (38:48) duplicated block id: 41 size: 9 cleaned lines of code in 2 files: - src/java/com/twitter/search/earlybird/partition/UserUpdatesStreamIndexer.java (32:43) - src/java/com/twitter/search/earlybird/partition/UserScrubGeoEventStreamIndexer.java (30:42) duplicated block id: 42 size: 9 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/relatedTweetHandlers/TweetBasedRelatedTweetsHandler.scala (26:37) - src/scala/com/twitter/recos/user_tweet_graph/relatedTweetHandlers/TweetBasedRelatedTweetsHandler.scala (27:38) duplicated block id: 43 size: 9 cleaned lines of code in 3 files: - src/scala/com/twitter/recos/user_video_graph/UserVideoGraphWriter.scala (70:80) - src/scala/com/twitter/recos/user_tweet_entity_graph/UserTweetEntityGraphWriter.scala (81:91) - src/scala/com/twitter/recos/user_tweet_graph/UserTweetGraphWriter.scala (76:86) duplicated block id: 44 size: 8 cleaned lines of code in 2 files: - product-mixer/shared-library/src/main/scala/com/twitter/product_mixer/shared_library/observer/ResultsStatsObserver.scala (197:206) - product-mixer/shared-library/src/main/scala/com/twitter/product_mixer/shared_library/observer/ResultsObserver.scala (209:218) duplicated block id: 45 size: 8 cleaned lines of code in 2 files: - twml/libtwml/src/ops/hashed_data_record.cpp (359:368) - twml/libtwml/src/ops/data_record.cpp (654:663) duplicated block id: 46 size: 8 cleaned lines of code in 2 files: - representation-manager/server/src/main/scala/com/twitter/representation_manager/migration/LegacyRMS.scala (560:569) - representation-manager/server/src/main/scala/com/twitter/representation_manager/store/UserSimClustersEmbeddingStore.scala (246:255) duplicated block id: 47 size: 8 cleaned lines of code in 2 files: - pushservice/src/main/scala/com/twitter/frigate/pushservice/util/SendHandlerPredicateUtil.scala (22:33) - pushservice/src/main/scala/com/twitter/frigate/pushservice/util/RFPHTakeStepUtil.scala (38:49) duplicated block id: 48 size: 8 cleaned lines of code in 2 files: - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/TweetBasedUnifiedSimilarityEngine.scala (442:453) - cr-mixer/server/src/main/scala/com/twitter/cr_mixer/similarity_engine/ProducerBasedUnifiedSimilarityEngine.scala (336:347) duplicated block id: 49 size: 8 cleaned lines of code in 2 files: - timelineranker/server/src/main/scala/com/twitter/timelineranker/util/TweetMediaFeatureExtractor.scala (104:113) - home-mixer/server/src/main/scala/com/twitter/home_mixer/util/tweetypie/content/TweetMediaFeaturesExtractor.scala (118:127) duplicated block id: 50 size: 8 cleaned lines of code in 2 files: - timelineranker/server/src/main/scala/com/twitter/timelineranker/util/TweetMediaFeatureExtractor.scala (216:225) - home-mixer/server/src/main/scala/com/twitter/home_mixer/util/tweetypie/content/TweetMediaFeaturesExtractor.scala (231:240) duplicated block id: 51 size: 8 cleaned lines of code in 2 files: - home-mixer/server/src/main/scala/com/twitter/home_mixer/product/scored_tweets/feature_hydrator/MetricCenterUserCountingFeatureHydrator.scala (62:71) - home-mixer/server/src/main/scala/com/twitter/home_mixer/product/scored_tweets/feature_hydrator/UserFollowedTopicIdsFeatureHydrator.scala (66:75) duplicated block id: 52 size: 8 cleaned lines of code in 2 files: - src/java/com/twitter/search/earlybird_root/RealtimeRootAppModule.java (118:127) - src/java/com/twitter/search/earlybird_root/RealtimeCgRootAppModule.java (119:128) duplicated block id: 53 size: 8 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/util/GetAllInternalTweetIdsUtil.scala (23:32) - src/scala/com/twitter/recos/user_tweet_graph/util/GetAllInternalTweetIdsUtil.scala (23:32) duplicated block id: 54 size: 7 cleaned lines of code in 2 files: - product-mixer/component-library/src/main/scala/com/twitter/product_mixer/component_library/module/TimelineMixerClientModule.scala (22:30) - product-mixer/component-library/src/main/scala/com/twitter/product_mixer/component_library/module/TimelineScorerClientModule.scala (22:30) duplicated block id: 55 size: 7 cleaned lines of code in 2 files: - product-mixer/component-library/src/main/scala/com/twitter/product_mixer/component_library/module/HomeScorerClientModule.scala (22:30) - product-mixer/component-library/src/main/scala/com/twitter/product_mixer/component_library/module/TimelineServiceClientModule.scala (25:33) duplicated block id: 56 size: 7 cleaned lines of code in 2 files: - timelineranker/server/src/main/scala/com/twitter/timelineranker/util/TweetMediaFeatureExtractor.scala (176:184) - home-mixer/server/src/main/scala/com/twitter/home_mixer/util/tweetypie/content/TweetMediaFeaturesExtractor.scala (191:199) duplicated block id: 57 size: 7 cleaned lines of code in 2 files: - timelineranker/server/src/main/scala/com/twitter/timelineranker/util/TweetMediaFeatureExtractor.scala (196:204) - home-mixer/server/src/main/scala/com/twitter/home_mixer/util/tweetypie/content/TweetMediaFeaturesExtractor.scala (211:219) duplicated block id: 58 size: 7 cleaned lines of code in 2 files: - timelineranker/server/src/main/scala/com/twitter/timelineranker/util/TweetMediaFeatureExtractor.scala (206:214) - home-mixer/server/src/main/scala/com/twitter/home_mixer/util/tweetypie/content/TweetMediaFeaturesExtractor.scala (221:229) duplicated block id: 59 size: 7 cleaned lines of code in 2 files: - src/java/com/twitter/search/earlybird_root/RealtimeRootAppModule.java (53:61) - src/java/com/twitter/search/earlybird_root/RealtimeCgRootAppModule.java (53:61) duplicated block id: 60 size: 7 cleaned lines of code in 2 files: - src/java/com/twitter/search/earlybird_root/RealtimeRootAppModule.java (66:74) - src/java/com/twitter/search/earlybird_root/RealtimeCgRootAppModule.java (66:74) duplicated block id: 61 size: 7 cleaned lines of code in 2 files: - src/java/com/twitter/search/earlybird_root/RealtimeRootAppModule.java (92:100) - src/java/com/twitter/search/earlybird_root/RealtimeCgRootAppModule.java (93:101) duplicated block id: 62 size: 7 cleaned lines of code in 2 files: - src/java/com/twitter/search/earlybird_root/RealtimeRootAppModule.java (105:113) - src/java/com/twitter/search/earlybird_root/RealtimeCgRootAppModule.java (106:114) duplicated block id: 63 size: 7 cleaned lines of code in 2 files: - src/scala/com/twitter/interaction_graph/scio/agg_all/InteractionGraphAggregationJob.scala (47:55) - src/scala/com/twitter/interaction_graph/scio/ml/scores/InteractionGraphScoreExportJob.scala (34:42) duplicated block id: 64 size: 7 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_video_graph/util/GetAllInternalTweetIdsUtil.scala (13:21) - src/scala/com/twitter/recos/user_tweet_graph/util/GetAllInternalTweetIdsUtil.scala (13:21) duplicated block id: 65 size: 6 cleaned lines of code in 3 files: - simclusters-ann/server/src/main/scala/com/twitter/simclustersann/candidate_source/ApproximateCosineSimilarity.scala (48:55) - simclusters-ann/server/src/main/scala/com/twitter/simclustersann/candidate_source/OptimizedApproximateCosineSimilarity.scala (28:35) - simclusters-ann/server/src/main/scala/com/twitter/simclustersann/candidate_source/ExperimentalApproximateCosineSimilarity.scala (25:32) duplicated block id: 66 size: 6 cleaned lines of code in 2 files: - timelineranker/server/src/main/scala/com/twitter/timelineranker/util/TweetMediaFeatureExtractor.scala (187:194) - home-mixer/server/src/main/scala/com/twitter/home_mixer/util/tweetypie/content/TweetMediaFeaturesExtractor.scala (202:209) duplicated block id: 67 size: 6 cleaned lines of code in 2 files: - src/java/com/twitter/search/ingester/pipeline/twitter/TextUrlsFeatureExtractionStage.java (32:40) - src/java/com/twitter/search/ingester/pipeline/twitter/ComputeTweetSignatureStage.java (18:26) duplicated block id: 68 size: 6 cleaned lines of code in 3 files: - src/java/com/twitter/search/earlybird/archive/segmentbuilder/SomeoneElseIsBuildingSegment.java (15:23) - src/java/com/twitter/search/earlybird/archive/segmentbuilder/NotYetBuiltSegment.java (21:29) - src/java/com/twitter/search/earlybird/archive/segmentbuilder/BuiltAndFinalizedSegment.java (8:16) duplicated block id: 69 size: 6 cleaned lines of code in 2 files: - src/scala/com/twitter/simclusters_v2/scalding/multi_type_graph/assemble_multi_type_graph/AssembleMultiTypeGraph.scala (31:38) - src/scala/com/twitter/simclusters_v2/scio/multi_type_graph/common/MultiTypeGraphUtil.scala (26:33) duplicated block id: 70 size: 6 cleaned lines of code in 2 files: - src/scala/com/twitter/recos/user_tweet_entity_graph/UserTweetEdgeTypeMask.scala (68:75) - src/scala/com/twitter/recos/graph_common/ActionEdgeTypeMask.scala (91:98)