본문 바로가기
728x90
반응형

Bigdata21

oozie jmx 모니터링 활성화 JMX를 통해 Oozie의 내부 상태와 성능 메트릭을 실시간으로 모니터링하고 분석할 수 있습니다. 메트릭 확인:CallableQueueService 관련 메트릭 워크플로우 및 코디네이터 작업 통계 시스템 리소스 사용량 등  모니터링 도구 연동: Prometheus나 Grafana 같은 도구와 연동하여 지속적인 모니터링 가능  Oozie JMX 활성화 및 조회: oozie-site.xml 설정 변경 oozie.jmx_monitoring.enable true  oozie-env.sh 파일에 다음과 같은 JVM 옵션을 추가 export CATALINA_OPTS="$CATALINA_OPTS -Dcom.sun.management.jmxremote -Dcohttp://m.sun.management.jmxrem.. 2024. 11. 18.
alembic.util.exc.CommandError: Can't locate revision identified by '22ed7efa9da2' airflow db upgrade를 실행 하다가 다음과 같은 에러가 발생하였습니다.alembic.util.exc.CommandError: Can't locate revision identified by '22ed7efa9da2'여기 저기 뒤져보니..머머를 삭제하면 된다고 했지만,저는 alembic을 초기화하니 해결 되었습니다.alembic init alembic 그리고 alembic.ini 파일 sqlalchemy.url 값을 수정하였습니다.sqlalchemy.url = mysql+pymysql://user:pass@localhost/dbname편의상 airflow-venv 위치에 했습니다. 2024. 8. 23.
Class org.apache.oozie.action.hadoop.SparkMain not found Error Messagejava.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.SparkMain not found Bug Fixoozie.use.system.libpath=trueoozie.action.sharelib.for.spark=spark-${version} 2024. 7. 5.
Could not find org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde. Error Message$ ./gradlew build> Task :compileJava FAILEDFAILURE: Build failed with an exception.* What went wrong:Execution failed for task ':compileJava'.> Could not resolve all files for configuration ':compileClasspath'. > Could not find org.pentaho:pentaho-aggdesigner-algorithm:5.1.5-jhyde. Searched in the following locations: - https://repo.maven.apache.org/maven2/org/pentaho/pe.. 2024. 6. 25.
728x90
반응형