×î½ü £¬²¿·ÖºÚ¿Í×éÖ¯Õë¶Ô¼¸¿îÌØ¶¨²úÆ·Õö¿ªÁËÀÕË÷¹¥»÷ ¡£×èÖ¹µ½ÉÏÖÜ £¬ÒÑÓÐÖÁÉÙ34000¶ą̀MongoDBÊý¾Ý¿â±»ºÚ¿Í×éÖ¯ÈëÇÖ £¬Êý¾Ý¿âÖеÄÊý¾Ý±»ºÚ¿Í²Á³ý²¢Ë÷ÒªÊê½ð ¡£

ÊÂÎñ×ÛÊö

×î½ü £¬²¿·ÖºÚ¿Í×éÖ¯Õë¶Ô¼¸¿îÌØ¶¨²úÆ·Õö¿ªÁËÀÕË÷¹¥»÷ ¡£×èÖ¹µ½ÉÏÖÜ £¬ÒÑÓÐÖÁÉÙ34000¶ą̀MongoDBÊý¾Ý¿â±»ºÚ¿Í×éÖ¯ÈëÇÖ £¬Êý¾Ý¿âÖеÄÊý¾Ý±»ºÚ¿Í²Á³ý²¢Ë÷ÒªÊê½ð ¡£Ëæºó £¬ÔÚ2017Äê1ÔÂ18ÈÕµ±Ìì £¬ÓÖÓÐÊý°Ų̀ElasticSearch·þÎñÆ÷Êܵ½ÁËÀÕË÷¹¥»÷ £¬·þÎñÆ÷ÖеÄÊý¾Ý±»²Á³ý ¡£Çå¾²Ñо¿Ö°Ô±Niall MerriganÌåÏÖ £¬×èÖ¹µ½ÏÖÔÚ £¬Êܹ¥»÷µÄElasticSearch·þÎñÆ÷ÒѾ­Áè¼ÝÁË2711̨ ¡£½ôËæÉÏÊöÁ½´Î¹¥»÷ÊÂÎñ £¬ÏÖÔÚÒѾ­Óкڿͽ«Ä¿µÄÃé×¼ÁËHadoop¼¯Èº ¡£ÕâЩÀÕË÷¹¥»÷µÄ¹¥»÷ģʽ¶¼½ÏΪÏàËÆ £¬ÔÚÕû¸ö¹¥»÷Àú³ÌÖв¢Ã»ÓÐʹÓÃÈκÎÀÕË÷Èí¼þ £¬Ò²Ã»ÓÐÉæ¼°Í¨ÀýÎó²î £¬¶øÊÇʹÓÃÏà¹Ø²úÆ·µÄ²»Çå¾²ÉèÖà £¬Ê¹¹¥»÷ÕßÓлú¿É³Ë £¬ÍòÎÞһʧµØ¶ÔÏà¹ØÊý¾Ý¾ÙÐвÙ×÷ ¡£

Hadoop¼ò½é

Apache HadoopÊÇÒ»¿îÖ§³ÖÊý¾Ý÷缯ÐÍÂþÑÜʽӦÓò¢ÒÔApache 2.0ÔÊÐíЭÒéÐû²¼µÄ¿ªÔ´Èí¼þ¿ò¼ÜÓÉJavaÓïÑÔʵÏÖ £¬ÒÔÅÌËã»ú¼¯ÈºµÄÐÎʽʵÏÖ¶Ôº£Á¿Êý¾ÝµÄÂþÑÜʽÅÌËã £¬¿É±àдºÍÔËÐÐÂþÑÜʽӦÓᢴ¦Öóͷ£´ó¹æÄ£Êý¾Ý ¡£Hadoop¿ò¼ÜµÄÁ½¸ö½¹µãÉè¼ÆÊÇHDFS£¨Hadoop Distributed File System£©ºÍMapReduce ¡£HDFSÊÇÒ»¸öÂþÑÜʽÎļþϵͳ £¬¾ßÓиßÈÝ´íÐÔµÄÌØµã £¬²¢ÇÒ±»Éè¼ÆÓÃÀ´°²ÅÅÔÚÁ®¼ÛµÄÓ²¼þÉÏ £»²¢ÇÒËüÄܹ»ÒÔ¸ßÍÌÍÂÁ¿À´»á¼ûÓ¦ÓóÌÐòµÄÊý¾Ý £¬ÓÈÆäÊʺÏÄÇЩÓÐ×ų¬´óÊý¾Ý¼¯µÄÓ¦ÓóÌÐò ¡£MapReduceÊÇÒ»¸öʹÓÃdzÒ×µÄÈí¼þ¿ò¼Ü £¬»ùÓÚËü±àд³öÀ´µÄÓ¦ÓóÌÐòÄܹ»ÔËÐÐÔÚÓÉÉÏǧ¸öÉÌÓûúе×é³ÉµÄ´óÐͼ¯ÈºÉÏ £¬²¢ÒÔÒ»ÖÖ¿É¿¿ÈÝ´íµÄ·½·¨²¢Ðд¦Öóͷ£ÉÏT¼¶±ðµÄÊý¾Ý¼¯ ¡£

ÀÕË÷¹¥»÷ģʽ

×î½ü·ºÆðµÄÕë¶ÔMongoDB¡¢ElasticSearchºÍHadoopµÄÀÕË÷¹¥»÷ģʽ¶¼½ÏΪÏàËÆ ¡£ÔÚ¹¥»÷Àú³ÌÖв¢Ã»ÓÐÉæ¼°ÀÕË÷Èí¼þºÍͨÀýÎó²î £¬¶øÊÇʹÓÃÏà¹Ø²úÆ·²»Çå¾²µÄÉèÖà £¬ÕâΪ¹¥»÷Õß·­¿ªÁËÀû±ãÖ®ÃÅ ¡£ÒÔMongoDBΪÀý £¬ÕâЩÊܹ¥»÷µÄÊý¾Ý¿âûÓнÓÄÉÈκÎÉí·ÝÑéÖ¤ £¬Ö±½Ó̻¶ÔÚInternet¹«ÍøÉÏ £¬Ò»µ©¹¥»÷ÕߵǼµ½ÕâЩ¿ª·ÅµÄÊý¾Ý¿â¾Í¿ÉÒÔ¶ÔÆäÖеÄÊý¾Ý¾ÙÐÐɾ³ýµÈ¶ñÒâ²Ù×÷ÁË £»¶øÕë¶ÔElasticSearch·þÎñÆ÷µÄÀÕË÷¹¥»÷ÊÖ¶ÎÒ²ÊÇÀàËÆ £¬ElasticSearchµÄTCP»á¼ûģʽµÄĬÈ϶˿ÚΪ9300 £¬HTTP»á¼ûģʽµÄĬÈ϶˿ÚΪ9200 £¬ÈôÊÇÕâЩ¶Ë¿Ú²»×öÈκα £»¤²½·¥µØÌ»Â¶ÔÚ¹«ÍøÉÏ £¬ÄÇô¶ÔËüµÄ»á¼û½«Ã»ÓÐÈκÎÉí·ÝÈÏÖ¤ £¬ÈκÎÈËÔÚ½¨ÉèÅþÁ¬Ö®ºó £¬¶¼¿ÉÒÔͨ¹ýÏà¹ØAPI¶ÔElasticSearch·þÎñÆ÷ÉϵÄÊý¾Ý¾ÙÐÐÔöɾ²é¸ÄµÈí§Òâ²Ù×÷ ¡£

¶øºÚ¿ÍÕë¶ÔHadoopµÄÀÕË÷¹¥»÷ £¬Ò²ÊÇʹÓÃÁË̻¶ÔÚ¹«ÍøÉÏµÄ¶Ë¿Ú ¡£Hadoop¼¯ÈºµÄʹÓÃÕßÍùÍù³öÓڱ㵱»òÕß×Ô¼ºÇå¾²Òâʶ²»Ç¿µÄÔµ¹Ê £¬»á½«HadoopµÄ²¿·Ö¶Ë¿Ú £¬ºÃ±ÈHDFSµÄWeb¶Ë¿Ú50070Ö±½ÓÔÚ¹«ÍøÉÏ¿ª·Å ¡£¹¥»÷Õß¿ÉÒÔ¼òÆÓʹÓÃÏà¹ØÏÂÁîÀ´²Ù×÷»úеÉϵÄÊý¾Ý £¬ºÃ±È£º

¾ÅÓÎÀϸ硤(Öйú)¾ãÀÖ²¿¹Ù·½ÍøÕ¾ 

 

ʹÓÃÉÏͼÃûÌÃÖеÄÏÂÁî¿ÉÒԵݹéɾ³ýtestĿ¼ÏµÄËùÓÐÄÚÈÝ ¡£

ƾ֤shodan.ioµÄͳ¼ÆÐ§¹ûÏÔʾ £¬ÔÚÖйúÓÐ8300¶à¸öHadoop¼¯ÈºµÄ50070¶Ë¿Ú̻¶ÔÚ¹«ÍøÉÏ £¬ÈçÏÂͼËùʾ£º

¾ÅÓÎÀϸ硤(Öйú)¾ãÀÖ²¿¹Ù·½ÍøÕ¾

 

 

£¨¸ÃͼƬÀ´×Ôshodan.io£©

·À»¤²½·¥

  • ¹Ø±Õ²»ÐëÒªµÄ¶Ë¿Ú ¡£HadoopËùʹÓõĶ˿ڼûÏÂ±í£º
HDFS NameNodeĬÈ϶˿ڣº50070
SecondNameNodeĬÈ϶˿ڣº50090
DataNodeĬÈ϶˿Ú:50075
Backup/Checkpoint NodeĬÈ϶˿ڣº50105
YARN ResourceManagerĬÈ϶˿ڣº8088
JobTrackerĬÈ϶˿ڣº50030
TaskTrackerĬÈ϶˿ڣº50060
Hue HueĬÈ϶˿ڣº8080

ÁбíÖеĶ˿ÚÈôÊÇÓû§²¢²»ÐèÒª £¬½¨Ò齫Æä¹Ø±Õ»òÕßÌí¼Ó·À»ðǽսÂÔ×è¶ÏÏìÓ¦Êý¾Ý°ü ¡£

  • ÆôÓÃKerberos ¡£ÔÚHadoop1.0.0»òÕßCDH3£¨CDHÊÇCloudera¹«Ë¾¶ÔHadoopÔ´ÂëÐ޸ĺóµÄÉÌÒµ¿¯Ðа棩°æ±¾Ö®Ç° £¬Hadoop²¢²»±£´æÇå¾²ÈÏÖ¤ ¡£ÔÚHadoop1.0.0»òÕßCDH3°æ±¾ºó £¬¼ÓÈëÁËKerberosÈÏÖ¤»úÖÆ ¡£¼¯ÈºÄڵĽڵãÐèʹÓÃÃÜÔ¿¾ÙÐÐÈÏÖ¤ £¬Ö»Óо­ÓÉÈÏÖ¤µÄ½Úµã²Å»ªÕý³£Ê¹Óà ¡£