text:
add table realtime error 500 org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory

hi @npawar @Xiang Fu
When the team looks at the error when adding the realtime table, the error 500 (ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory)
INFO [AddTableCommand] [main] {"code": 500, "error": "org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory"}
my table realtime config
{
"tableName": "airlineStats",
"tableType": "REALTIME",
"segmentsConfig": {
"schemaName": "airlineStats",
"timeColumnName": "daysSinceEpoch",
"timeType": "DAYS",
"replication": "1",
"segmentAssignmentStrategy": "BalanceNumSegmentAssignmentStrategy",
"replicasPerPartition": "1",
"retentionTimeUnit": "DAYS",
"retentionTimeValue": "365",
"segmentPushType": "APPEND",
"completionConfig": {
"completionMode": "DOWNLOAD"
}
},
"tenants": {},
"tableIndexConfig": {
"loadMode": "MMAP",
"aggregateMetrics": true,
"nullHandlingEnabled": false,
"streamConfigs": {
"streamType": "kafka",
"stream.kafka.consumer.type": "lowlevel",
"stream.kafka.topic.name": "flights-realtime",
"stream.kafka.decoder.class.name": "org.apache.pinot.plugin.stream.kafka.KafkaJSONMessageDecoder",
"stream.kafka.broker.list": "broker01-kafka-ovm-2-172.tgdd.vn:9101,broker02-kafka-ovm-2-177.tgdd.vn:9102,broker03-kafka-ovm-2 -230.tgdd.vn:9103,broker04-kafka-ovm-2-231.tgdd.vn:9104,broker05-kafka-ovm-2-250.tgdd.vn:9105,broke
r06-kafka-ovm-2-251.tgdd.vn:9106 ",
"realtime.segment.flush.threshold.size": "0",
"realtime.segment.flush.threshold.time": "24h",
"realtime.segment.flush.desired.size": "150M",
"stream.kafka.consumer.prop.auto.offset.reset": "largest"
}
},
"metadata": {
"customConfigs": {}
}
}

How do you start pinot? Is it directly from quickstart commandline ? Or you modified the JAVA_OPTS parameter?
That may remove the default plugins directory.

tks @fx19880617  I have it fixed

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

Is your Kafka server accessible from the Pinot docker container?

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

Is your Kafka server accessible from the Pinot docker container?

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

Is your Kafka server accessible from the Pinot docker container?

yes. it is able to curl

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

Is your Kafka server accessible from the Pinot docker container?

yes. it is able to curl

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

2021/01/14 02:29:21.979 INFO [ControllerStarter] [main] Starting Pinot controller in mode: DUAL. 2021/01/14 02:29:22.045 INFO [ControllerStarter] [main] Starting Helix controller 2021/01/14 02:29:22.308 INFO [HelixSetupUtils] [main] Creating a new Helix cluster: pinot-cluster-docker 2021/01/14 02:29:23.608 INFO [HelixSetupUtils] [main] New Helix cluster: pinot-cluster-docker created 2021/01/14 02:29:24.365 INFO [HelixSetupUtils] [main] Adding state model: SegmentOnlineOfflineStateModel with CONSUMING state 2021/01/14 02:29:24.401 INFO [HelixSetupUtils] [main] Adding state model: BrokerResourceOnlineOfflineStateModel 2021/01/14 02:29:24.444 INFO [HelixSetupUtils] [main] Adding resource: brokerResource 2021/01/14 02:29:24.465 INFO [HelixSetupUtils] [main] Adding resource: leadControllerResource 2021/01/14 02:29:24.710 INFO [ControllerStarter] [main] Initializing PinotFSFactory 2021/01/14 02:29:24.712 INFO [ControllerStarter] [main] Initializing ControllerFilePathProvider 2021/01/14 02:29:24.715 INFO [ControllerFilePathProvider] [main] Data directory: file:/home/ubuntu/pinot/savd/generated/controller-data/ 2021/01/14 02:29:24.722 INFO [ControllerFilePathProvider] [main] Local temporary directory: /home/ubuntu/pinot/savd/generated/temp 2021/01/14 02:29:24.722 INFO [ControllerFilePathProvider] [main] File upload temporary directory: /home/ubuntu/pinot/savd/generated/temp/fileUploadTemp 2021/01/14 02:29:24.723 INFO [ControllerFilePathProvider] [main] Untarred file temporary directory: /home/ubuntu/pinot/savd/generated/temp/untarredFileTemp 2021/01/14 02:29:24.723 INFO [ControllerFilePathProvider] [main] File download temporary directory: /home/ubuntu/pinot/savd/generated/temp/fileDownloadTemp 2021/01/14 02:29:24.731 INFO [ControllerStarter] [main] Initializing SegmentFetcherFactory 2021/01/14 02:29:25.116 INFO [ControllerStarter] [main] Initializing PinotCrypterFactory 2021/01/14 02:29:25.118 INFO [ControllerStarter] [main] Initializing Helix participant manager 2021/01/14 02:29:25.162 INFO [ControllerStarter] [main] Initializing lead controller manager 2021/01/14 02:29:25.164 INFO [ControllerStarter] [main] Registering and connecting Helix participant manager as Helix Participant role 2021/01/14 02:29:25.841 INFO [ControllerStarter] [main] Registering helix controller listener 2021/01/14 02:29:25.862 INFO [LeadControllerManager] [main] Became Helix leader 2021/01/14 02:29:25.862 INFO [ControllerStarter] [main] Registering resource config listener 2021/01/14 02:29:25.889 INFO [LeadControllerManager] [main] Lead controller resource is disabled. 2021/01/14 02:29:25.895 INFO [ControllerStarter] [main] Starting lead controller manager 2021/01/14 02:29:25.897 INFO [ControllerStarter] [main] Starting Pinot Helix resource manager and connecting to Zookeeper 2021/01/14 02:29:25.909 INFO [PinotHelixResourceManager] [main] Controller: Controller_pinot-controller-0_9000 doesn't contain group tag: controller. Adding one. 2021/01/14 02:29:26.121 INFO [ControllerStarter] [main] Starting task resource manager 2021/01/14 02:29:26.126 INFO [ControllerStarter] [main] Starting realtime segment manager 2021/01/14 02:29:26.147 INFO [MetadataEventNotifierFactory] [main] Instantiating metadata event notifier factory class org.apache.pinot.controller.api.events.DefaultMetadataEventNotifierFactory 2021/01/14 02:29:26.154 INFO [ControllerStarter] [main] Realtime tables with High Level consumers will be supported 2021/01/14 02:29:26.156 INFO [PinotRealtimeSegmentManager] [main] Starting realtime segments manager, adding a listener on the property store table configs path. 2021/01/14 02:29:26.208 INFO [PinotRealtimeSegmentManager] [main] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:29:26.208 INFO [PinotRealtimeSegmentManager] [main] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:29:26.210 INFO [ControllerStarter] [main] Setting up periodic tasks 2021/01/14 02:29:26.287 INFO [RetentionManager] [main] Starting RetentionManager with runFrequencyInSeconds: 21600, deletedSegmentsRetentionInDays: 7 2021/01/14 02:29:26.691 INFO [ControllerStarter] [main] Init controller periodic tasks scheduler 2021/01/14 02:29:26.719 INFO [SegmentStatusChecker] [main] Initializing table metrics for all the tables. 2021/01/14 02:29:26.743 INFO [ControllerStarter] [main] Use class: org.apache.pinot.controller.api.access.AllowAllAccessFactory as the AccessControlFactory 2021/01/14 02:29:26.745 INFO [MetadataEventNotifierFactory] [main] Instantiating metadata event notifier factory class org.apache.pinot.controller.api.events.DefaultMetadataEventNotifierFactory 2021/01/14 02:29:26.745 INFO [ControllerStarter] [main] Controller download url base: http://pinot-controller-0:9000 2021/01/14 02:29:26.745 INFO [ControllerStarter] [main] Injecting configuration and resource managers to the API context 2021/01/14 02:29:27.086 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_0 2021/01/14 02:29:27.088 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_1 2021/01/14 02:29:27.142 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_2 2021/01/14 02:29:27.161 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_3 2021/01/14 02:29:27.161 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_19 2021/01/14 02:29:27.162 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_5 2021/01/14 02:29:27.165 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_4 2021/01/14 02:29:27.215 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_7 2021/01/14 02:29:27.216 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_6 2021/01/14 02:29:27.291 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_13 2021/01/14 02:29:27.291 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_22 2021/01/14 02:29:27.292 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_8 2021/01/14 02:29:27.292 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_12 2021/01/14 02:29:27.297 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_23 2021/01/14 02:29:27.299 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_11 2021/01/14 02:29:27.299 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_14 2021/01/14 02:29:27.302 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_18 2021/01/14 02:29:27.302 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_17 2021/01/14 02:29:27.302 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_9 2021/01/14 02:29:27.319 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_16 2021/01/14 02:29:27.320 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_15 2021/01/14 02:29:27.322 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_10 2021/01/14 02:29:27.323 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_21 2021/01/14 02:29:27.325 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_20 2021/01/14 02:29:27.630 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_0 2021/01/14 02:29:27.630 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_0 to LeadControllerManager 2021/01/14 02:29:27.655 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_1 2021/01/14 02:29:27.655 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_1 to LeadControllerManager 2021/01/14 02:29:28.178 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_2 2021/01/14 02:29:28.179 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_2 to LeadControllerManager 2021/01/14 02:29:28.194 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_19 2021/01/14 02:29:28.194 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_19 to LeadControllerManager 2021/01/14 02:29:28.238 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_3 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_3 to LeadControllerManager 2021/01/14 02:29:28.239 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_4 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_4 to LeadControllerManager 2021/01/14 02:29:28.239 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_6 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_6 to LeadControllerManager 2021/01/14 02:29:28.239 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_5 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_5 to LeadControllerManager 2021/01/14 02:29:28.240 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_7 2021/01/14 02:29:28.240 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_14 2021/01/14 02:29:28.241 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_14 to LeadControllerManager 2021/01/14 02:29:28.242 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_7 to LeadControllerManager 2021/01/14 02:29:28.251 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_8 2021/01/14 02:29:28.251 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_8 to LeadControllerManager 2021/01/14 02:29:28.273 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_9 2021/01/14 02:29:28.273 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_9 to LeadControllerManager 2021/01/14 02:29:28.275 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_13 2021/01/14 02:29:28.275 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_13 to LeadControllerManager 2021/01/14 02:29:28.335 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_17 2021/01/14 02:29:28.335 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_17 to LeadControllerManager 2021/01/14 02:29:28.335 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_12 2021/01/14 02:29:28.335 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_12 to LeadControllerManager 2021/01/14 02:29:28.336 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_23 2021/01/14 02:29:28.336 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_23 to LeadControllerManager 2021/01/14 02:29:28.370 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_20 2021/01/14 02:29:28.370 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_20 to LeadControllerManager 2021/01/14 02:29:28.370 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_11 2021/01/14 02:29:28.370 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_11 to LeadControllerManager 2021/01/14 02:29:28.371 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_18 2021/01/14 02:29:28.371 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_18 to LeadControllerManager 2021/01/14 02:29:28.371 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_22 2021/01/14 02:29:28.371 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_22 to LeadControllerManager 2021/01/14 02:29:28.371 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_10 2021/01/14 02:29:28.372 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_10 to LeadControllerManager 2021/01/14 02:29:28.372 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_16 2021/01/14 02:29:28.372 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_16 to LeadControllerManager 2021/01/14 02:29:28.373 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_15 2021/01/14 02:29:28.373 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_21 2021/01/14 02:29:28.373 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_21 to LeadControllerManager 2021/01/14 02:29:28.373 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_15 to LeadControllerManager 2021/01/14 02:29:38.713 INFO [ControllerAdminApiApplication] [main] Admin API started on ports: 9000 2021/01/14 02:29:38.714 INFO [ControllerStarter] [main] Controller services available at http://0.0.0.0:9000/ 2021/01/14 02:31:58.723 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:31:58.723 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:32:06.734 INFO [ControllerPeriodicTask] [pool-7-thread-2] Processing 0 tables in task: RealtimeSegmentRelocator 2021/01/14 02:32:06.734 INFO [ControllerPeriodicTask] [pool-7-thread-2] Finish processing 0/0 tables in task: RealtimeSegmentRelocator 2021/01/14 02:32:12.698 INFO [ControllerPeriodicTask] [pool-7-thread-3] Processing 0 tables in task: RetentionManager 2021/01/14 02:32:12.698 INFO [RetentionManager] [pool-7-thread-3] Removing aged (more than 7 days) deleted segments for all tables 2021/01/14 02:32:12.698 WARN [SegmentDeletionManager] [pool-7-thread-3] Deleted segment directory file:/home/ubuntu/pinot/savd/generated/controller-data//Deleted_Segments does not exist or it is not directory. 2021/01/14 02:32:12.698 INFO [ControllerPeriodicTask] [pool-7-thread-3] Finish processing 0/0 tables in task: RetentionManager 2021/01/14 02:32:26.704 INFO [ControllerPeriodicTask] [pool-7-thread-4] Processing 0 tables in task: OfflineSegmentIntervalChecker 2021/01/14 02:32:26.704 INFO [ControllerPeriodicTask] [pool-7-thread-4] Finish processing 0/0 tables in task: OfflineSegmentIntervalChecker 2021/01/14 02:34:06.709 INFO [ControllerPeriodicTask] [pool-7-thread-5] Processing 0 tables in task: RealtimeSegmentValidationManager 2021/01/14 02:34:06.710 INFO [RealtimeSegmentValidationManager] [pool-7-thread-5] Run segment-level validation 2021/01/14 02:34:06.710 INFO [ControllerPeriodicTask] [pool-7-thread-5] Finish processing 0/0 tables in task: RealtimeSegmentValidationManager 2021/01/14 02:34:07.714 INFO [ControllerPeriodicTask] [pool-7-thread-6] Processing 0 tables in task: BrokerResourceValidationManager 2021/01/14 02:34:07.726 INFO [ControllerPeriodicTask] [pool-7-thread-6] Finish processing 0/0 tables in task: BrokerResourceValidationManager 2021/01/14 02:34:32.380 INFO [PinotSchemaRestletResource] [grizzly-http-server-9] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:34:32.390 INFO [ControllerResponseFilter] [grizzly-http-server-9] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=OpKyY-MMeGzEGQgcXBTcZF8HubWWFYwKQUuFeJ status code 200 OK 2021/01/14 02:34:32.573 INFO [PinotTableRestletResource] [grizzly-http-server-6] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:34:32.574 INFO [PinotTableRestletResource] [grizzly-http-server-6] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:34:32.624 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleChildChange: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.624 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.624 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.626 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleDataChange: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.626 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.626 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.631 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleChildChange: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.631 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.631 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.635 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-6] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.645 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleChildChange with table: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE/siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.645 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE/siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.645 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE/siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.650 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Computed list of new segments to add : [] 2021/01/14 02:34:32.659 ERROR [PinotTableRestletResource] [grizzly-http-server-6] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:34:32.668 INFO [ControllerResponseFilter] [grizzly-http-server-6] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error 2021/01/14 02:36:58.724 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:36:58.724 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:40:39.696 INFO [PinotHelixResourceManager] [grizzly-http-server-7] New schema is the same with the existing schema. Not updating schema siteareavisitordata 2021/01/14 02:40:39.696 INFO [PinotSchemaRestletResource] [grizzly-http-server-7] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:40:39.698 INFO [ControllerResponseFilter] [grizzly-http-server-7] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=FZRWA6qG0-9gNGmFNsL4JRxwr8s8OeYpVAC1u1tU status code 200 OK 2021/01/14 02:40:39.796 INFO [PinotTableRestletResource] [grizzly-http-server-8] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:40:39.797 INFO [PinotTableRestletResource] [grizzly-http-server-8] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:40:39.882 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-8] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:40:39.893 ERROR [PinotTableRestletResource] [grizzly-http-server-8] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:40:39.894 INFO [ControllerResponseFilter] [grizzly-http-server-8] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error 2021/01/14 02:41:58.725 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:41:58.725 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:42:56.024 INFO [PinotHelixResourceManager] [grizzly-http-server-10] New schema is the same with the existing schema. Not updating schema siteareavisitordata 2021/01/14 02:42:56.024 INFO [PinotSchemaRestletResource] [grizzly-http-server-10] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:42:56.024 INFO [ControllerResponseFilter] [grizzly-http-server-10] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=h9vyedtn75Jcxi_TxfjdHmKT7Ca8diKl72 status code 200 OK 2021/01/14 02:42:56.089 INFO [PinotTableRestletResource] [grizzly-http-server-5] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:42:56.090 INFO [PinotTableRestletResource] [grizzly-http-server-5] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:42:56.198 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-5] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:42:56.212 ERROR [PinotTableRestletResource] [grizzly-http-server-5] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:42:56.214 INFO [ControllerResponseFilter] [grizzly-http-server-5] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error 2021/01/14 02:46:58.727 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:46:58.727 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:48:29.608 INFO [PinotHelixResourceManager] [grizzly-http-server-4] New schema is the same with the existing schema. Not updating schema siteareavisitordata 2021/01/14 02:48:29.608 INFO [PinotSchemaRestletResource] [grizzly-http-server-4] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:48:29.609 INFO [ControllerResponseFilter] [grizzly-http-server-4] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=nvBrezW-5M_BiEjVSeWLSOtwbGYZx67CXp status code 200 OK 2021/01/14 02:48:29.670 INFO [PinotTableRestletResource] [grizzly-http-server-3] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:48:29.671 INFO [PinotTableRestletResource] [grizzly-http-server-3] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:48:29.693 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-3] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:48:29.701 ERROR [PinotTableRestletResource] [grizzly-http-server-3] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:48:29.702 INFO [ControllerResponseFilter] [grizzly-http-server-3] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error

Hi there I have the exact same problem. How did you fix it?
I start pinot with docker following guides in quickstart, ingesting data from kafka in another server.
I didnt modify JAVA_OPTS.

do you have pinot controller logs?
typically it's because of kafka connection failure.

2021/01/14 02:29:21.979 INFO [ControllerStarter] [main] Starting Pinot controller in mode: DUAL. 2021/01/14 02:29:22.045 INFO [ControllerStarter] [main] Starting Helix controller 2021/01/14 02:29:22.308 INFO [HelixSetupUtils] [main] Creating a new Helix cluster: pinot-cluster-docker 2021/01/14 02:29:23.608 INFO [HelixSetupUtils] [main] New Helix cluster: pinot-cluster-docker created 2021/01/14 02:29:24.365 INFO [HelixSetupUtils] [main] Adding state model: SegmentOnlineOfflineStateModel with CONSUMING state 2021/01/14 02:29:24.401 INFO [HelixSetupUtils] [main] Adding state model: BrokerResourceOnlineOfflineStateModel 2021/01/14 02:29:24.444 INFO [HelixSetupUtils] [main] Adding resource: brokerResource 2021/01/14 02:29:24.465 INFO [HelixSetupUtils] [main] Adding resource: leadControllerResource 2021/01/14 02:29:24.710 INFO [ControllerStarter] [main] Initializing PinotFSFactory 2021/01/14 02:29:24.712 INFO [ControllerStarter] [main] Initializing ControllerFilePathProvider 2021/01/14 02:29:24.715 INFO [ControllerFilePathProvider] [main] Data directory: file:/home/ubuntu/pinot/savd/generated/controller-data/ 2021/01/14 02:29:24.722 INFO [ControllerFilePathProvider] [main] Local temporary directory: /home/ubuntu/pinot/savd/generated/temp 2021/01/14 02:29:24.722 INFO [ControllerFilePathProvider] [main] File upload temporary directory: /home/ubuntu/pinot/savd/generated/temp/fileUploadTemp 2021/01/14 02:29:24.723 INFO [ControllerFilePathProvider] [main] Untarred file temporary directory: /home/ubuntu/pinot/savd/generated/temp/untarredFileTemp 2021/01/14 02:29:24.723 INFO [ControllerFilePathProvider] [main] File download temporary directory: /home/ubuntu/pinot/savd/generated/temp/fileDownloadTemp 2021/01/14 02:29:24.731 INFO [ControllerStarter] [main] Initializing SegmentFetcherFactory 2021/01/14 02:29:25.116 INFO [ControllerStarter] [main] Initializing PinotCrypterFactory 2021/01/14 02:29:25.118 INFO [ControllerStarter] [main] Initializing Helix participant manager 2021/01/14 02:29:25.162 INFO [ControllerStarter] [main] Initializing lead controller manager 2021/01/14 02:29:25.164 INFO [ControllerStarter] [main] Registering and connecting Helix participant manager as Helix Participant role 2021/01/14 02:29:25.841 INFO [ControllerStarter] [main] Registering helix controller listener 2021/01/14 02:29:25.862 INFO [LeadControllerManager] [main] Became Helix leader 2021/01/14 02:29:25.862 INFO [ControllerStarter] [main] Registering resource config listener 2021/01/14 02:29:25.889 INFO [LeadControllerManager] [main] Lead controller resource is disabled. 2021/01/14 02:29:25.895 INFO [ControllerStarter] [main] Starting lead controller manager 2021/01/14 02:29:25.897 INFO [ControllerStarter] [main] Starting Pinot Helix resource manager and connecting to Zookeeper 2021/01/14 02:29:25.909 INFO [PinotHelixResourceManager] [main] Controller: Controller_pinot-controller-0_9000 doesn't contain group tag: controller. Adding one. 2021/01/14 02:29:26.121 INFO [ControllerStarter] [main] Starting task resource manager 2021/01/14 02:29:26.126 INFO [ControllerStarter] [main] Starting realtime segment manager 2021/01/14 02:29:26.147 INFO [MetadataEventNotifierFactory] [main] Instantiating metadata event notifier factory class org.apache.pinot.controller.api.events.DefaultMetadataEventNotifierFactory 2021/01/14 02:29:26.154 INFO [ControllerStarter] [main] Realtime tables with High Level consumers will be supported 2021/01/14 02:29:26.156 INFO [PinotRealtimeSegmentManager] [main] Starting realtime segments manager, adding a listener on the property store table configs path. 2021/01/14 02:29:26.208 INFO [PinotRealtimeSegmentManager] [main] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:29:26.208 INFO [PinotRealtimeSegmentManager] [main] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:29:26.210 INFO [ControllerStarter] [main] Setting up periodic tasks 2021/01/14 02:29:26.287 INFO [RetentionManager] [main] Starting RetentionManager with runFrequencyInSeconds: 21600, deletedSegmentsRetentionInDays: 7 2021/01/14 02:29:26.691 INFO [ControllerStarter] [main] Init controller periodic tasks scheduler 2021/01/14 02:29:26.719 INFO [SegmentStatusChecker] [main] Initializing table metrics for all the tables. 2021/01/14 02:29:26.743 INFO [ControllerStarter] [main] Use class: org.apache.pinot.controller.api.access.AllowAllAccessFactory as the AccessControlFactory 2021/01/14 02:29:26.745 INFO [MetadataEventNotifierFactory] [main] Instantiating metadata event notifier factory class org.apache.pinot.controller.api.events.DefaultMetadataEventNotifierFactory 2021/01/14 02:29:26.745 INFO [ControllerStarter] [main] Controller download url base: http://pinot-controller-0:9000 2021/01/14 02:29:26.745 INFO [ControllerStarter] [main] Injecting configuration and resource managers to the API context 2021/01/14 02:29:27.086 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_0 2021/01/14 02:29:27.088 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_1 2021/01/14 02:29:27.142 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_2 2021/01/14 02:29:27.161 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_3 2021/01/14 02:29:27.161 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_19 2021/01/14 02:29:27.162 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_5 2021/01/14 02:29:27.165 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_4 2021/01/14 02:29:27.215 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_7 2021/01/14 02:29:27.216 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_6 2021/01/14 02:29:27.291 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_13 2021/01/14 02:29:27.291 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_22 2021/01/14 02:29:27.292 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_8 2021/01/14 02:29:27.292 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_12 2021/01/14 02:29:27.297 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_23 2021/01/14 02:29:27.299 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_11 2021/01/14 02:29:27.299 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_14 2021/01/14 02:29:27.302 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_18 2021/01/14 02:29:27.302 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_17 2021/01/14 02:29:27.302 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_9 2021/01/14 02:29:27.319 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_16 2021/01/14 02:29:27.320 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_15 2021/01/14 02:29:27.322 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_10 2021/01/14 02:29:27.323 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_21 2021/01/14 02:29:27.325 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from OFFLINE to SLAVE for partition: leadControllerResource_20 2021/01/14 02:29:27.630 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_0 2021/01/14 02:29:27.630 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_0 to LeadControllerManager 2021/01/14 02:29:27.655 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_1 2021/01/14 02:29:27.655 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_1 to LeadControllerManager 2021/01/14 02:29:28.178 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_2 2021/01/14 02:29:28.179 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_2 to LeadControllerManager 2021/01/14 02:29:28.194 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_19 2021/01/14 02:29:28.194 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_19 to LeadControllerManager 2021/01/14 02:29:28.238 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_3 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_3 to LeadControllerManager 2021/01/14 02:29:28.239 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_4 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_4 to LeadControllerManager 2021/01/14 02:29:28.239 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_6 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_6 to LeadControllerManager 2021/01/14 02:29:28.239 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_5 2021/01/14 02:29:28.239 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_5 to LeadControllerManager 2021/01/14 02:29:28.240 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_7 2021/01/14 02:29:28.240 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_14 2021/01/14 02:29:28.241 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_14 to LeadControllerManager 2021/01/14 02:29:28.242 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_7 to LeadControllerManager 2021/01/14 02:29:28.251 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_8 2021/01/14 02:29:28.251 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_8 to LeadControllerManager 2021/01/14 02:29:28.273 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_9 2021/01/14 02:29:28.273 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_9 to LeadControllerManager 2021/01/14 02:29:28.275 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_13 2021/01/14 02:29:28.275 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_13 to LeadControllerManager 2021/01/14 02:29:28.335 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_17 2021/01/14 02:29:28.335 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_17 to LeadControllerManager 2021/01/14 02:29:28.335 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_12 2021/01/14 02:29:28.335 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_12 to LeadControllerManager 2021/01/14 02:29:28.336 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_23 2021/01/14 02:29:28.336 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_23 to LeadControllerManager 2021/01/14 02:29:28.370 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_20 2021/01/14 02:29:28.370 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_20 to LeadControllerManager 2021/01/14 02:29:28.370 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_11 2021/01/14 02:29:28.370 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_11 to LeadControllerManager 2021/01/14 02:29:28.371 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_18 2021/01/14 02:29:28.371 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_18 to LeadControllerManager 2021/01/14 02:29:28.371 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_22 2021/01/14 02:29:28.371 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_22 to LeadControllerManager 2021/01/14 02:29:28.371 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_10 2021/01/14 02:29:28.372 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_10 to LeadControllerManager 2021/01/14 02:29:28.372 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_16 2021/01/14 02:29:28.372 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_16 to LeadControllerManager 2021/01/14 02:29:28.373 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_15 2021/01/14 02:29:28.373 INFO [LeadControllerResourceMasterSlaveStateModelFactory$LeadControllerResourceMasterSlaveStateModel] [HelixTaskExecutor-message_handle_thread] Got state transition from SLAVE to MASTER for partition: leadControllerResource_21 2021/01/14 02:29:28.373 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_21 to LeadControllerManager 2021/01/14 02:29:28.373 INFO [LeadControllerManager] [HelixTaskExecutor-message_handle_thread] Add Partition: leadControllerResource_15 to LeadControllerManager 2021/01/14 02:29:38.713 INFO [ControllerAdminApiApplication] [main] Admin API started on ports: 9000 2021/01/14 02:29:38.714 INFO [ControllerStarter] [main] Controller services available at http://0.0.0.0:9000/ 2021/01/14 02:31:58.723 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:31:58.723 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:32:06.734 INFO [ControllerPeriodicTask] [pool-7-thread-2] Processing 0 tables in task: RealtimeSegmentRelocator 2021/01/14 02:32:06.734 INFO [ControllerPeriodicTask] [pool-7-thread-2] Finish processing 0/0 tables in task: RealtimeSegmentRelocator 2021/01/14 02:32:12.698 INFO [ControllerPeriodicTask] [pool-7-thread-3] Processing 0 tables in task: RetentionManager 2021/01/14 02:32:12.698 INFO [RetentionManager] [pool-7-thread-3] Removing aged (more than 7 days) deleted segments for all tables 2021/01/14 02:32:12.698 WARN [SegmentDeletionManager] [pool-7-thread-3] Deleted segment directory file:/home/ubuntu/pinot/savd/generated/controller-data//Deleted_Segments does not exist or it is not directory. 2021/01/14 02:32:12.698 INFO [ControllerPeriodicTask] [pool-7-thread-3] Finish processing 0/0 tables in task: RetentionManager 2021/01/14 02:32:26.704 INFO [ControllerPeriodicTask] [pool-7-thread-4] Processing 0 tables in task: OfflineSegmentIntervalChecker 2021/01/14 02:32:26.704 INFO [ControllerPeriodicTask] [pool-7-thread-4] Finish processing 0/0 tables in task: OfflineSegmentIntervalChecker 2021/01/14 02:34:06.709 INFO [ControllerPeriodicTask] [pool-7-thread-5] Processing 0 tables in task: RealtimeSegmentValidationManager 2021/01/14 02:34:06.710 INFO [RealtimeSegmentValidationManager] [pool-7-thread-5] Run segment-level validation 2021/01/14 02:34:06.710 INFO [ControllerPeriodicTask] [pool-7-thread-5] Finish processing 0/0 tables in task: RealtimeSegmentValidationManager 2021/01/14 02:34:07.714 INFO [ControllerPeriodicTask] [pool-7-thread-6] Processing 0 tables in task: BrokerResourceValidationManager 2021/01/14 02:34:07.726 INFO [ControllerPeriodicTask] [pool-7-thread-6] Finish processing 0/0 tables in task: BrokerResourceValidationManager 2021/01/14 02:34:32.380 INFO [PinotSchemaRestletResource] [grizzly-http-server-9] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:34:32.390 INFO [ControllerResponseFilter] [grizzly-http-server-9] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=OpKyY-MMeGzEGQgcXBTcZF8HubWWFYwKQUuFeJ status code 200 OK 2021/01/14 02:34:32.573 INFO [PinotTableRestletResource] [grizzly-http-server-6] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:34:32.574 INFO [PinotTableRestletResource] [grizzly-http-server-6] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:34:32.624 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleChildChange: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.624 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.624 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.626 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleDataChange: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.626 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.626 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.631 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleChildChange: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.631 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.631 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE 2021/01/14 02:34:32.635 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-6] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.645 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] PinotRealtimeSegmentManager.handleChildChange with table: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE/siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.645 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Processing change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE/siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.645 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Received change notification for path: /pinot-cluster-docker/PROPERTYSTORE/CONFIGS/TABLE/siteareavisitordatakafka_REALTIME 2021/01/14 02:34:32.650 INFO [PinotRealtimeSegmentManager] [ZkClient-EventThread-52-pinot-zookeeper:2181] Computed list of new segments to add : [] 2021/01/14 02:34:32.659 ERROR [PinotTableRestletResource] [grizzly-http-server-6] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:34:32.668 INFO [ControllerResponseFilter] [grizzly-http-server-6] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error 2021/01/14 02:36:58.724 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:36:58.724 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:40:39.696 INFO [PinotHelixResourceManager] [grizzly-http-server-7] New schema is the same with the existing schema. Not updating schema siteareavisitordata 2021/01/14 02:40:39.696 INFO [PinotSchemaRestletResource] [grizzly-http-server-7] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:40:39.698 INFO [ControllerResponseFilter] [grizzly-http-server-7] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=FZRWA6qG0-9gNGmFNsL4JRxwr8s8OeYpVAC1u1tU status code 200 OK 2021/01/14 02:40:39.796 INFO [PinotTableRestletResource] [grizzly-http-server-8] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:40:39.797 INFO [PinotTableRestletResource] [grizzly-http-server-8] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:40:39.882 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-8] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:40:39.893 ERROR [PinotTableRestletResource] [grizzly-http-server-8] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:40:39.894 INFO [ControllerResponseFilter] [grizzly-http-server-8] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error 2021/01/14 02:41:58.725 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:41:58.725 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:42:56.024 INFO [PinotHelixResourceManager] [grizzly-http-server-10] New schema is the same with the existing schema. Not updating schema siteareavisitordata 2021/01/14 02:42:56.024 INFO [PinotSchemaRestletResource] [grizzly-http-server-10] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:42:56.024 INFO [ControllerResponseFilter] [grizzly-http-server-10] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=h9vyedtn75Jcxi_TxfjdHmKT7Ca8diKl72 status code 200 OK 2021/01/14 02:42:56.089 INFO [PinotTableRestletResource] [grizzly-http-server-5] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:42:56.090 INFO [PinotTableRestletResource] [grizzly-http-server-5] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:42:56.198 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-5] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:42:56.212 ERROR [PinotTableRestletResource] [grizzly-http-server-5] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:42:56.214 INFO [ControllerResponseFilter] [grizzly-http-server-5] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error 2021/01/14 02:46:58.727 INFO [ControllerPeriodicTask] [pool-7-thread-1] Processing 0 tables in task: SegmentStatusChecker 2021/01/14 02:46:58.727 INFO [ControllerPeriodicTask] [pool-7-thread-1] Finish processing 0/0 tables in task: SegmentStatusChecker 2021/01/14 02:48:29.608 INFO [PinotHelixResourceManager] [grizzly-http-server-4] New schema is the same with the existing schema. Not updating schema siteareavisitordata 2021/01/14 02:48:29.608 INFO [PinotSchemaRestletResource] [grizzly-http-server-4] Notifying metadata event for adding new schema siteareavisitordata 2021/01/14 02:48:29.609 INFO [ControllerResponseFilter] [grizzly-http-server-4] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/schemas, content-type multipart/form-data; boundary=nvBrezW-5M_BiEjVSeWLSOtwbGYZx67CXp status code 200 OK 2021/01/14 02:48:29.670 INFO [PinotTableRestletResource] [grizzly-http-server-3] Validating table configs for Table: siteareavisitordatakafka 2021/01/14 02:48:29.671 INFO [PinotTableRestletResource] [grizzly-http-server-3] Table: siteareavisitordatakafka is not a hybrid table. Skipping consistency check across realtime and offline parts of the table. 2021/01/14 02:48:29.693 INFO [PinotLLCRealtimeSegmentManager] [grizzly-http-server-3] Setting up new LLC table: siteareavisitordatakafka_REALTIME 2021/01/14 02:48:29.701 ERROR [PinotTableRestletResource] [grizzly-http-server-3] org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory java.lang.ClassNotFoundException: org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory 	at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_265] 	at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_265] 	at org.apache.pinot.spi.plugin.PluginClassLoader.loadClass(PluginClassLoader.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:268) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:239) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.plugin.PluginManager.createInstance(PluginManager.java:220) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.StreamConsumerFactoryProvider.create(StreamConsumerFactoryProvider.java:36) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.spi.stream.PartitionCountFetcher.<init>(PartitionCountFetcher.java:41) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.getPartitionCount(PinotTableIdealStateBuilder.java:118) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.getNumPartitions(PinotLLCRealtimeSegmentManager.java:600) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.realtime.PinotLLCRealtimeSegmentManager.setUpNewTable(PinotLLCRealtimeSegmentManager.java:215) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotTableIdealStateBuilder.buildLowLevelRealtimeIdealStateFor(PinotTableIdealStateBuilder.java:114) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.ensureRealtimeClusterIsSetUp(PinotHelixResourceManager.java:1277) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.helix.core.PinotHelixResourceManager.addTable(PinotHelixResourceManager.java:1132) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.apache.pinot.controller.api.resources.PinotTableRestletResource.addTable(PinotTableRestletResource.java:127) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_265] 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_265] 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_265] 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_265] 	at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:124) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:167) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:219) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:79) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:469) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:391) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:80) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:292) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:274) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.internal.Errors.process(Errors.java:244) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:232) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:679) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:353) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) ~[pinot-all-0.5.0-jar-with-dependencies.jar:0.5.0-d87bbc9032c6efe626eb5f9ef1db4de7aa067179] 	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265] 2021/01/14 02:48:29.702 INFO [ControllerResponseFilter] [grizzly-http-server-3] Handled request from 172.18.0.6 POST http://pinot-controller-0:9000/tables, content-type application/x-www-form-urlencoded status code 500 Internal Server Error

repo: apache/incubator-pinot