Handle by itself#
Attention
Current SmoothCrawler-Cluster version, it doesn’t support this feature.
Managing the meta-data objects by crawler instance self.
Crawler which supports to manage meta-data by itself:
nothing, it will support this feature in the future.
It would manage the meta-data without any outside applications. So we could setup crawler cluster directly without setup some applications first.