Redis 中spark參數executor-cores引起的異常解決辦法
報錯信息
Unexpected end of stream
16/10/11 16:35:50 WARN TaskSetManager: Lost task 63.0 in stage 3.0 (TID 212, gzns-arch-spark04.gzns.iwm.name): redis.clients.jedis.exceptions.JedisConnectionException: Unexpected end of stream.
at redis.clients.util.RedisInputStream.ensureFill(RedisInputStream.java:199)
at redis.clients.util.RedisInputStream.readByte(RedisInputStream.java:40)
at redis.clients.jedis.Protocol.process(Protocol.java:151)
at redis.clients.jedis.Protocol.read(Protocol.java:215)
at redis.clients.jedis.Connection.readProtocolWithCheckingBroken(Connection.java:340)
at redis.clients.jedis.Connection.getBinaryMultiBulkReply(Connection.java:276)
at redis.clients.jedis.Connection.getMultiBulkReply(Connection.java:269)
at redis.clients.jedis.Jedis.hmget(Jedis.java:723)
DENIED Redis is running in protected mode because protected mode is enabled
DENIED Redis is running in protected mode because protected mode is enabled,
no bind address was specified, no authentication password is requested to clients.
In this mode connections are only accepted from the loopback interface.
If you want to connect from external computers to Redis you may adopt one of
the following solutions: 1) Just disable protected mode sending the command
'CONFIG SET protected-mode no' from the loopback interface by connecting to
Redis from the same host the server is running, however MAKE SURE Redis is not
publicly accessible from internet if you do so. Use CONFIG REWRITE to make this change
permanent.
2) Alternatively you can just disable the protected mode by editing the
Redis configuration file, and setting the protected mode option to 'no',
and then restarting the server. 3) If you started the server manually just
for testing, restart it with the '--protected-mode no' option. 4) Setup a bind
address or an authentication password. NOTE: You only need to do one of the above
things in order for the server to start accepting connections from the outside.
at redis.clients.jedis.Protocol.processError(Protocol.java:127)
at redis.clients.jedis.Protocol.process(Protocol.java:161)
at redis.clients.jedis.Protocol.read(Protocol.java:215)
解決過程
我嘗試重啟redis,更換redis新jar包，關閉redis保護模式都于事無補,后來找了下錯誤的原因,無意中看到了Unexpected end of stream是說有一個進程占用了redis的鏈接，頭腦一炸，才發現自己把executor-cores設置為了2，然后把該值設置為1后，正常了。
看來只有等接入redis集群后，我才能修改該值了。
感謝閱讀，希望能幫助到大家，謝謝大家對本站的支持！
您可能感興趣的文章:- PHP+redis實現微博的拉模型案例詳解
- PHP+redis實現微博的推模型案例分析
- 基于springboot和redis實現單點登錄
- Redis如何優雅的刪除特定前綴key
- CentOS7安裝配置 Redis的方法步驟
- 如何解決redis的NOAUTH Authentication required異常
