大数据个人学习笔记

02-06 09:30

#0

这是个人学习笔记，随时记录，随时修改，不能保证正确性，因此有需要的朋友可以移步到我的CSDN博客或者个人博客阅读。CSDN博客:http://blog.csdn.net/sunnyyoona
如果有问题，可以发送到我的邮箱: 1203745031@qq.com

Spark 3.1.3 HADOOP_CONF_DIR or YARN_CONF_DIR must be set.md

Spark 3.1.3 java.lang.NoSuchFieldError: JAVA_9.md

Spark 3.1.3 top 使用 Comparator 抛出 java.io.NotSerializableException 异常.md

Spark Streaming Incomplete HDFS URI, no host.md

Spark Streaming object not serializable.md

Spark Task not serializable.md

Spark Wrong value latest of auto.offset.reset in ConsumerConfig.md

[Spark]Spark No suitable driver found for jdbc:hive:xxx.md

[Spark]Spark {{JAVA_HOME}}找不到.md

那些年我们遇到的 Spark 的坑.md

Spark 性能调优之序列化.md

Spark 性能调优之数据倾斜调优.md

[Spark]Spark 性能调优之Shuffle调优.md

[Spark]Spark 性能调优之内存调优.md

[Spark]Spark 性能调优之开发调优.md

[Spark]Spark 性能调优之资源调优.md

[Spark]Spark 性能调优之避免使用GroupByKey.md

[Spark]Spark指南五招迅速提升你的流处理程序.md

[Spark]万亿级数据规模下的倾斜调优.md

img-spark-performance-data-skew-tuning-1.png

img-spark-performance-data-skew-tuning-10.png

img-spark-performance-data-skew-tuning-11.png

img-spark-performance-data-skew-tuning-12.png

img-spark-performance-data-skew-tuning-13.png

img-spark-performance-data-skew-tuning-14.png

img-spark-performance-data-skew-tuning-15.png

img-spark-performance-data-skew-tuning-16.png

img-spark-performance-data-skew-tuning-17.png

img-spark-performance-data-skew-tuning-18.png

img-spark-performance-data-skew-tuning-2.png

img-spark-performance-data-skew-tuning-3.png

img-spark-performance-data-skew-tuning-4.png

img-spark-performance-data-skew-tuning-5.png

img-spark-performance-data-skew-tuning-6.png

img-spark-performance-data-skew-tuning-7.png

img-spark-performance-data-skew-tuning-8.png

img-spark-performance-data-skew-tuning-9.png

Spark 入门 Persist,Cache以及Checkpoint.md

Spark 入门 RDD 持久化.md

Spark 入门 RDD 操作.md

Spark 入门 Shark, Spark SQL, Hive on Spark以及SQL On Spark的未来.md

Spark 入门 Shuffle 操作.md

Spark 入门 Spark 代码分析.md

Spark 入门共享变量.md

Spark 入门初始化 Spark.md

Spark 入门在 Yarn 上运行 Spark 应用程序.md

Spark 入门如何使用累加器 Accumulator.md

Spark 入门如何查看 RDD 有多少分区.md

Spark 入门引入 Spark.md

Spark 入门弹性分布式数据集(RDD).md

Spark 入门理解 Spark 的核心 RDD.md

Spark 入门理解闭包.md

Spark 入门第一个程序-WordCount.md

Spark 安装与启动.md

未完-Spark 入门如何配置日志.md

Spark 使用 spark-submit 部署应用程序.md

Spark 在 Driver 上输出 RDD 元素.md

Spark 实战几种 Join 示例.md

Spark 实战多文件输出.md

Spark 实战如何使用 Spark UI 来检查 Spark 的运行状态？.md

[Spark]Spark Shuffle发展史.md

[Spark]Spark 通过可视化来了解Spark应用程序.md

[Spark]Spark和Hadoop中的Shuffle操作.md

[Spark]一个用于大规模数据科学的API---DataFrame.md

img-spark-web-ui-check-status-1.png

img-spark-web-ui-check-status-2.png

img-spark-web-ui-check-status-3.png

未完-Spark 理解 Spark 序列化.md

Spark 内部原理之运行原理.md

Spark 内部原理之运行模式.md

[20180502]Spark 内部原理之Shuffle架构.md

[Spark]Spark 内部原理之内存管理.md

img-spark-internal-operating-principle-one-1.jpg

img-spark-internal-operating-principle-one-10.jpg

img-spark-internal-operating-principle-one-11.jpg

img-spark-internal-operating-principle-one-12.jpg

img-spark-internal-operating-principle-one-13.jpg

img-spark-internal-operating-principle-one-14.jpg

img-spark-internal-operating-principle-one-15.jpg

img-spark-internal-operating-principle-one-16.jpg

img-spark-internal-operating-principle-one-17.jpg

img-spark-internal-operating-principle-one-18.jpg

img-spark-internal-operating-principle-one-19.jpg

img-spark-internal-operating-principle-one-2.jpg

img-spark-internal-operating-principle-one-20.jpg

img-spark-internal-operating-principle-one-21.jpg

img-spark-internal-operating-principle-one-22.jpg

img-spark-internal-operating-principle-one-23.jpg

img-spark-internal-operating-principle-one-24.jpg

img-spark-internal-operating-principle-one-25.jpg

img-spark-internal-operating-principle-one-26.jpg

img-spark-internal-operating-principle-one-27.jpg

img-spark-internal-operating-principle-one-3.jpg

img-spark-internal-operating-principle-one-4.jpg

img-spark-internal-operating-principle-one-5.jpg

img-spark-internal-operating-principle-one-6.jpg

img-spark-internal-operating-principle-one-7.jpg

img-spark-internal-operating-principle-one-8.jpg

img-spark-internal-operating-principle-one-9.jpg

Spark On Mesos 运行模式.md

Spark 剖析Spark作业运行机制.md

Spark 实战：Web UI 使用指南.md

Spark 运行日志.md

MyBatis2个子项

TroubleShooting2个子项

MyBatis or DELIMITER expected, got 'xxx'.md

MyBatis 中文写入数据库变问号.md

基础8个子项

MyBatis Generator 插件使用指南.md

MyBatis XML 映射器 Mapper 增删改查.md

MyBatis 动态 SQL.md

MyBatis 是什么.md

img-mybatis-generator-plugin-1.png

img-mybatis-generator-plugin-2.png

img-mybatis-generator-plugin-3.png

mybatis-statement-or-delimiter-expected-1.png

Mybatis-Plus1个子项

MyBatis-Plus 入门指南.md

Mybatis2个子项

TroubleShooting1个子项

Mybatis Type interface xxxMapper is not known to the MapperRegistry.md

基础1个子项

Mybatis 快速入门.md

Spring9个子项

Spring Ioc 控制反转.md

Spring 依赖注入之 XML 自动装配.md

Spring 依赖注入之setter注入.md

Spring 依赖注入之构造器注入.md

Spring 依赖注入之注解自动装配.md

Spring 数据库操作 JdbcTemplate.md

[Spring]各组件详解.md

[Spring]配置详解.md

SpringBoot2个子项

TroubleShooting2个子项

Spring Boot 2.7.11 spring.porfiles 不生效问题.md

Spring Boot 配置文件无法自动提示.md

基础2个子项

SpringBoot 快速搭建入门项目.md

SpringBoot 配置文件如何配置与读取.md

SpringCloud1个子项

[20181210]Spring Cloud 服务治理.md

SpringMVC2个子项

TroubleShooting1个子项

Spring MVC 引入 Jackson 触发 ClassFormatException: Invalid byte tag in constant pool: 19 异常.md

基础2个子项

Spring MVC DispatcherServlet Servlet 配置.md

Spring MVC 快速搭建入门项目.md

Tomcat2个子项

Apahce Tomcat 安装与启动.md

Maven tomcat7-maven-plugin 插件.md

[20171025]Sqoop 安装与部署.md

[20171025]那些年我们碰到过的Sqoop坑.md

[20171026]Sqoop 如何导入数据.md

[20171029]Sqoop 深入理解导入过程.md

[20171030]Sqoop 如何增量导入.md

[20171101]Sqoop 导入数据到Hive.md

[20171121]Sqoop 大对象处理.md

[20180810]Sqoop 入门.md

[Sqoop]Sqoop 导入与导出.md

[Sqoop]那些年踩过的Sqoop坑.md

TroubleShooting1个子项

[20190812]那些年我们已经遇到过的Storm坑.md

优化4个子项

[20181108]Storm MaxSpoutPending.md

[20181210]什么时候使用Trident?.md

[20190110]Storm backPressure背压机制.md

[20190111]Storm 如何设置worker,spout和bolt的数目.md

原理6个子项

[20181203]理解 Storm 拓扑的并行度.md

[20181218]Storm 拓扑的生命周期.md

[20181218]Storm 理解内部消息缓存机制.md

[20181219]Storm Ack框架实现.md

[20190111]Storm Trident Batch.md

[20190114]Storm Spout 等待策略.md

基础21个子项

[20181019]Storm与HBase集成.md

[20181025]Storm 安装与启动.md

[20181031]Storm 本地模式.md

[20181031]Storm 集群模式.md

[20181109]Storm 那些年我们一起遇到过的Storm坑.md

[20181207]Storm 拓扑的生命周期.md

[20181212]Storm与JDBC集成.md

[20181214]Storm Core 中的窗口机制.md

[20181220]Storm 的历史及经验教训.md

[20190110]Storm RotatingMap.md

[20190112]Storm 动态调整Rebalance.md

[20190118]Storm Trident 入门.md

[20190123]Storm 分流与合流.md

[20190126]Storm Tick 元组.md

[20190516]如何理解Storm中的分组.md

[20190517]Storm 的可靠性保证测试.md

[20190518]Storm与Redis集成.md

[20190525]Storm BasicBolt vs RichBolt.md

[201908010]Storm 流Join.md

[20190802]Storm UI REST API.md

容错1个子项

[20181103]Storm 消息处理的可靠性保证.md

监控5个子项

[20181102]Storm 自定义监控.md

[20181108]Storm 使用Storm UI监控应用程序.md

[20181231]Storm Metric.md

[20181231]Storm 自定义日志与Appender.md

[20190818]Storm Metrics Reporting API v2.md

Exactly once 未必严格一致.md

Stream 精选内容.md

[20180807]Spark比拼Flink：下一代大数据计算引擎之争，谁主沉浮？.md

[20191229]实时架构演进.md

[20200104]Lambda 架构的质疑.md

[20220115]Streaming 101:批处理之外的流式世界第一部分.md

[20220116]Streaming 102:批处理之外的流式世界第二部分.md

[20220131]对流处理的误解.md

[Stream]Spark Streaming 和 Flink详细对比.md

[Stream]Spark VS Flink.md

[Stream]Spark vs MapReduce.md

[Stream]主流流处理框架比较第一部分.md

[Stream]主流流处理框架比较第二部分.md

[Stream]如何选择Spark和Flink.md

FreeMarker4个子项

Apache FreeMaker 命名空间.md

Apache FreeMarker 入门.md

Apache FreeMarker 常见使用指令.md

Apahce FreeMarker 第一个程序 HelloWorld.md

待看文章.md

[20180507]Hadoop Yarn 上调度器.md

[20211017]Hadoop Yarn 节点健康监测机制.md

Base2个子项

[20210612]在Zeppelin中如何使用Flink.md

[20210613]Zeppelin 绑定模式.md

Other1个子项

Zeppelin 精选文章汇总.md

TroubleShooting1个子项

[20201017]那些年我们一起遇到过的Zeppelin坑.md

实战14个子项

Zeppelin 实战：Zeppelin 安装与启动.md

Zeppelin 实战：设置访问登录权限.md

zeppelin-install-and-config-1.jpg

zeppelin-install-and-config-2.jpg

zeppelin-install-and-config-3.jpg

zeppelin-install-and-config-4.jpg

zeppelin-install-and-config-5.jpg

zeppelin-install-and-config-6.jpg

zeppelin-install-and-config-7.jpg

zeppelin-install-and-config-8.jpg

zeppelin-install-and-config-9.jpg

zeppelin-login-authority-1.png

zeppelin-login-authority-2.png

在 Zeppelin 中如何使用 Hive.md

Base7个子项

[20190816]ZooKeeper CLI.md

[20190820]分布式协调服务ZooKeeper.md

[20190824]ZooKeeper日志配置.md

[20190901]ZooKeeper客户端命名空间.md

[20190902]ZooKeeper可视化监控ZKUI.md

[20190917]ZooKeeper 权限控制 Java API.md

[20190928]ZooKeeper ACL权限控制机制.md

TroubleShooting1个子项

[20200829]那些年我们一起追过的ZooKeeper的坑.md

实战13个子项

ZooKeeper 实战：ZooKeeper Java API.md

ZooKeeper 实战：ZooKeeper 伪集群模式安装与启动.md

ZooKeeper 实战：ZooKeeper 集群模式安装与启动.md

ZooKeeper 实战：使用 Docker Compose 部署 Zookeeper 集群.md

ZooKeeper 实战：使用 Docker 搭建 Zookeeper 集群.md

ZooKeeper 实战：如何使用 Watcher.md

how-to-use-watcher-in-zookeeper-1.jpg

zookeeper-setup-and-run-with-docker-1.png

zookeeper-setup-and-run-with-docker-2.png

zookeeper-setup-and-run-with-docker-3.png

zookeeper-setup-and-run-with-docker-4.png

zookeeper-setup-and-run-with-docker-5.png

zookeeper-setup-and-run-with-docker-6.png

Case6个子项

evolution-of-real-time-computing-platform-in-mafengwo-1.png

evolution-of-real-time-computing-platform-in-mafengwo-2.png

evolution-of-real-time-computing-platform-in-mafengwo-3.png

evolution-of-real-time-computing-platform-in-mafengwo-4.png

evolution-of-real-time-computing-platform-in-mafengwo-5.png

evolution-of-real-time-computing-platform-in-mafengwo-6.png

ClickHouse8个子项

technology-evolution-of-clickHouse-in-toutiao-1.png

technology-evolution-of-clickHouse-in-toutiao-2.png

technology-evolution-of-clickHouse-in-toutiao-3.png

technology-evolution-of-clickHouse-in-toutiao-4.png

technology-evolution-of-clickHouse-in-toutiao-5.png

technology-evolution-of-clickHouse-in-toutiao-6.png

technology-evolution-of-clickHouse-in-toutiao-7.png

technology-evolution-of-clickHouse-in-toutiao-8.png

ElasticSearch7个子项

elasticsearch-base-making-changes-persistent-1.png

elasticsearch-base-making-changes-persistent-2.png

elasticsearch-base-making-changes-persistent-3.png

elasticsearch-base-making-changes-persistent-4.png

elasticsearch-base-near-real-time-search-1.png

elasticsearch-base-near-real-time-search-2.png

elasticsearch-how-to-use-analysis-and-analyser-1.png

Flink68个子项

20201220161328.jpg

Flink 分布式运行环境-1.png

Flink 分布式运行环境-2.png

Flink 分布式运行环境-3.png

Flink 分布式运行环境-4.png

Flink 分布式运行环境-5.png

Flink 执行计划-1.png

Flink 执行计划-2.png

apache-flink-1-5-0-release-1.png

apache-flink-1-5-0-release-2.png

broadcast-state-pattern-flink-considerations-1.png

build-first-flink-application-1.jpg

build-first-flink-application-2.jpg

build-first-flink-application-3.jpg

build-first-flink-application-4.jpg

build-first-flink-application-5.jpg

build-first-flink-application-6.jpg

flink-batch-internals-memory-management-1.png

flink-batch-internals-memory-management-2.png

flink-batch-internals-memory-management-3.png

flink-batch-internals-memory-management-4.png

flink-how-to-install-and-run-1.png

flink-internals-how-to-build-streamgraph-1.png

flink-kafka-connector-1.jpg

flink-monitoring-rest-api-1.jpg

flink-stream-asynchronous-io-for-external-data-access-1.png

flink-stream-operators-overall.png

flink_internals_job_scheduling-1.png

flink_internals_job_scheduling-2.png

flink_internals_job_scheduling-3.png

flink_internals_job_scheduling-4.png

how-to-use-queryable-state-of-flink-1.png

how-to-use-queryable-state-of-flink-2.png

how-to-use-queryable-state-of-flink-3.png

how-to-use-queryable-state-of-flink-4.png

introducing-complex-event-processing-with-flink-1.png

事件时间与Watermarks-1.png

事件时间与Watermarks-2.png

事件时间与Watermarks-3.png

内部原理之数据流容错-1.png

内部原理之数据流容错-2.png

内部原理之数据流容错-3.png

图解事件时间与Watermarks-0.png

图解事件时间与Watermarks-4.png

图解事件时间与Watermarks-2.png

图解事件时间与Watermarks-3.png

图解事件时间与Watermarks-5.png

数据流类型与转换关系-1.png

数据流类型与转换关系-2.png

数据流类型与转换关系-3.png

数据流类型与转换关系-4.png

数据流类型与转换关系-5.png

生成时间戳与Watermarks-1.png

HBase42个子项

hbase-pseudo-distributed-setup-and-start-1.jpg

hbase-pseudo-distributed-setup-and-start-2.jpg

hbase-pseudo-distributed-setup-and-start-3.jpg

hbase-setup-and-start-1.jpg

in-depth-look-hbase-architecture-1.png

in-depth-look-hbase-architecture-10.png

in-depth-look-hbase-architecture-11.png

in-depth-look-hbase-architecture-12.png

in-depth-look-hbase-architecture-13.png

in-depth-look-hbase-architecture-14.png

in-depth-look-hbase-architecture-15.png

in-depth-look-hbase-architecture-16.png

in-depth-look-hbase-architecture-17.png

in-depth-look-hbase-architecture-18.png

in-depth-look-hbase-architecture-19.png

in-depth-look-hbase-architecture-2.png

in-depth-look-hbase-architecture-20.png

in-depth-look-hbase-architecture-21.png

in-depth-look-hbase-architecture-22.png

in-depth-look-hbase-architecture-23.png

in-depth-look-hbase-architecture-24.png

in-depth-look-hbase-architecture-25.png

in-depth-look-hbase-architecture-26.png

in-depth-look-hbase-architecture-3.png

in-depth-look-hbase-architecture-4.png

in-depth-look-hbase-architecture-5.png

in-depth-look-hbase-architecture-6.png

in-depth-look-hbase-architecture-7.png

in-depth-look-hbase-architecture-8.png

in-depth-look-hbase-architecture-9.png

introduction-to-hbase-schema-design-1.jpg

introduction-to-hbase-schema-design-10.jpg

introduction-to-hbase-schema-design-11.jpg

introduction-to-hbase-schema-design-2.jpg

introduction-to-hbase-schema-design-3.jpg

introduction-to-hbase-schema-design-4.jpg

introduction-to-hbase-schema-design-5.jpg

introduction-to-hbase-schema-design-6.jpg

introduction-to-hbase-schema-design-7.jpg

introduction-to-hbase-schema-design-8.jpg

introduction-to-hbase-schema-design-9.jpg

start-of-a-new-era-apache-hBase-1.0.jpeg

Hadoop39个子项

2017-12-16 21-00-14屏幕截图.png

2017-12-16 21-00-51屏幕截图.png

2017-12-16 21-01-23屏幕截图.png

Hadoop Checkpointing检查点机制-checkpointing1.png

Hadoop Checkpointing检查点机制-checkpointing2.png

Hadoop Checkpointing检查点机制-checkpointing3.png

Hadoop Checkpointing检查点机制-checkpointing4.png

Hadoop Secondary NameNode的作用-1.png

Hadoop Secondary NameNode的作用-2.png

Hadoop2.x HDFS架构-1.png

Hadoop2.x HDFS架构-2.png

Hadoop下一代MapReduce-yarn-architecture.gif

Hadoop指南磁盘均衡器-hdfs-disk-balancing-policy.jpg

hadoop-base-how-to-use-sequencefile-and-mapfile-1.png

hadoop-base-how-to-use-sequencefile-and-mapfile-2.png

hadoop-basics-total-order-sorting-mapreduce-1.png

hadoop-basics-total-order-sorting-mapreduce-2.png

hadoop-data-compress-1.png

hadoop-ecosystem-break-away-jvm-1.jpg

hadoop-ecosystem-break-away-jvm-2.jpg

hadoop-ecosystem-break-away-jvm-3.jpg

hadoop-hdfs-high-availability-in-hadoop-2.2.0-1.jpg

hadoop-hdfs-high-availability-with-qjm-1.png

hadoop-hdfs-high-availability-with-qjm-2.png

hadoop-hdfs-high-availability-with-qjm-3.png

hadoop-hdfs-high-availability-with-qjm-4.png

hadoop-hdfs-high-availability-with-qjm-5.png

hadoop-hdfs-high-availability-with-qjm-6.png

hadoop-hdfs-high-availability-with-qjm-7.png

hadoop-hdfs-high-availability-with-qjm-8.png

hadoop-how-to-use-compression-1.png

hadoop-how-to-use-compression-2.png

hadoop-how-to-use-compression-3.png

hadoop-how-to-use-compression-4.png

hadoop-how-to-use-compression-5.png

hadoop-how-to-use-compression-6.png

hadoop-internal-anatomy-of-hadoop-streaming-1.png

trouble-shooting-cannot-access-port-50070-in-hadoop-1.png

trouble-shooting-cannot-access-port-50070-in-hadoop-2.png

Hexo51个子项

2017-12-01 19-48-53屏幕截图.png

2017-12-03 16-47-40屏幕截图.png

2017-12-16 16-49-46屏幕截图.png

Hexo+Github为NexT主题添加文章阅读量统计功能-1.png

Hexo+Github为NexT主题添加文章阅读量统计功能-10.png

Hexo+Github为NexT主题添加文章阅读量统计功能-2.png

Hexo+Github为NexT主题添加文章阅读量统计功能-3.png

Hexo+Github为NexT主题添加文章阅读量统计功能-4.png

Hexo+Github为NexT主题添加文章阅读量统计功能-5.png

Hexo+Github为NexT主题添加文章阅读量统计功能-6.png

Hexo+Github为NexT主题添加文章阅读量统计功能-7.png

Hexo+Github为NexT主题添加文章阅读量统计功能-8.png

Hexo+Github为NexT主题添加文章阅读量统计功能-9.png

Hexo+Github搭建静态博客-1.png

Hexo+Github搭建静态博客-10.png

Hexo+Github搭建静态博客-11.png

Hexo+Github搭建静态博客-12.png

Hexo+Github搭建静态博客-13.png

Hexo+Github搭建静态博客-14.png

Hexo+Github搭建静态博客-15.png

Hexo+Github搭建静态博客-16.png

Hexo+Github搭建静态博客-2.png

Hexo+Github搭建静态博客-3.png

Hexo+Github搭建静态博客-4.png

Hexo+Github搭建静态博客-5.png

Hexo+Github搭建静态博客-6.png

Hexo+Github搭建静态博客-7.png

Hexo+Github搭建静态博客-8.png

Hexo+Github搭建静态博客-9.png

Hexo+Github配置与主题-1.png

Hexo+Github配置与主题-2.png

add-a-comment-function-to-the-next-theme-of-hexo-1.png

add-a-comment-function-to-the-next-theme-of-hexo-10.png

add-a-comment-function-to-the-next-theme-of-hexo-11.png

add-a-comment-function-to-the-next-theme-of-hexo-12.png

add-a-comment-function-to-the-next-theme-of-hexo-13.png

add-a-comment-function-to-the-next-theme-of-hexo-14.png

add-a-comment-function-to-the-next-theme-of-hexo-15.png

add-a-comment-function-to-the-next-theme-of-hexo-2.png

add-a-comment-function-to-the-next-theme-of-hexo-3.png

add-a-comment-function-to-the-next-theme-of-hexo-4.png

add-a-comment-function-to-the-next-theme-of-hexo-5.png

add-a-comment-function-to-the-next-theme-of-hexo-6.png

add-a-comment-function-to-the-next-theme-of-hexo-7.png

add-a-comment-function-to-the-next-theme-of-hexo-8.png

add-a-comment-function-to-the-next-theme-of-hexo-9.png

hexo-next-add-copyright-information-1.png

hexo-next-add-copyright-information-2.png

post-default.jpg

Kafka16个子项

cmak-managing-apache-kafka-cluster-1.jpg

cmak-managing-apache-kafka-cluster-2.jpg

cmak-managing-apache-kafka-cluster-3.jpg

cmak-managing-apache-kafka-cluster-4.jpg

ML1个子项

OpenTSDB4个子项

Other37个子项

Presto15个子项

SQL1个子项

Spark74个子项

Storm16个子项

Stream33个子项

UserProfile9个子项

ZooKeeper15个子项

首页上页4下页共6页

点赞回复