Skip to content

ATLAS-3924: Add Comprehensive Documentation for Hive Metastore Hook#395

Open
divija21 wants to merge 2 commits intoapache:masterfrom
divija21:ATLAS-3924
Open

ATLAS-3924: Add Comprehensive Documentation for Hive Metastore Hook#395
divija21 wants to merge 2 commits intoapache:masterfrom
divija21:ATLAS-3924

Conversation

@divija21
Copy link

@divija21 divija21 commented Jul 3, 2025

ATLAS-3924 :

This PR introduces a new documentation file HookHive.md to explain the Hive Metastore Hook, which was originally implemented under ATLAS-3148 but lacked official usage guidance on the Apache Atlas documentation site that is mentioned in [ATLAS-3924]

The documentation aims to make it easy for users to configure and understand the purpose of the Hive Metastore Hook.

It includes :

  1. Overview: Role of the hook in capturing Hive DDL operations (like CREATE/DROP TABLE).
  2. Configuration Instructions:
  • How to enable the hook via hive.metastore.event.listeners.
    
  • Steps to copy hook files into Hive
    
  • Update instructions for hive-env.sh and atlas-application.properties.
    
  1. Atlas Hook Properties:
  • Kafka/Zookeeper configuration
  • Threading, retries, and cluster settings
  1. How It Works:
  • DDL events from Hive are pushed to Atlas Kafka topic .
    

Demonstration of Setup in Action
Hive CLI - HiveCli
Atlas UI (Database View) - Atlas.odt
Atlas UI (Atlas UI (Table View))- Atlas.pdf

@mihailyonchev
Copy link

What happened here @divija21 , no reviewers?

@divija21
Copy link
Author

What happened here @divija21 , no reviewers?
Hi @mihailyonchev, thanks for checking in.
This documentation PR was opened some time ago and has been awaiting review, as no reviewers were assigned. If this change is still relevant, I’d appreciate your guidance on whether it can be reviewed and merged, or if there’s anything you’d like me to update. Happy to act on your suggestion. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants