Unable to join course

[ddevadat]

published a course, but unable to join it. I throws the error

{"id":".discussion.forum.v2.read","ver":"1.0","ts":"2025-07-29 12:15:44:601+0000","params":{"resmsgid":"5f36c090-2eee-11eb-80ed-6bb70096c082","msgid":"18de2027461f8130af18392fc28eaf23","status":"failed","err":"DMW_FRED01","errmsg":"Forum read failed because of nodebb-plugin-create-forum plugin not enabled."}}

[ddevadat]

First enabled nodebb plugin

kubectl exec -n dev deploy/nodebb -- ./nodebb activate nodebb-plugin-create-forum
    kubectl exec -n dev deploy/nodebb -- ./nodebb activate nodebb-plugin-sunbird-oidc
    kubectl exec -n dev deploy/nodebb -- ./nodebb activate nodebb-plugin-write-api

restarted nodebb pod

But now batch creation is failing

{
    "id": "api.course.batch.create",
    "ver": "v1",
    "ts": "2025-07-30 10:30:49:812+0000",
    "params": {
        "resmsgid": null,
        "msgid": "cce2112e-e47a-4bfa-ad01-3900a533580b",
        "err": "DB_INSERTION_FAIL",
        "status": "DB_INSERTION_FAIL",
        "errmsg": "DB insert operation failed."
    },
    "responseCode": "SERVER_ERROR",
    "result": {}
}

lms pod is thrwing this error

2025-07-30 10:30:49,809 {"actor":{"id":"86a7905e-6caf-4e53-b2b9-408c00816f76","type":"user"},"eid":"LOG","edata":{"level":"ERROR","requestid":"cce2112e-e47a-4bfa-ad01-3900a533580b","type":"system","message":"Exception occured while inserting record to course_batch : Keyspace 'sunbird_courses' does not exist"},"ver":"3.0","ets":1753871449809,"context":{"channel":"course-service","pdata":{"ver":"1.0","pid":"course-service","id":"org.sunbird.course-service"},"env":"","did":"5d231d886cdba3cdc3a3f6cc9b182aa4","sid":"qLFDpiXnmGyMZLgr-K2t_gBmI1_L-vTs"},"mid":"LOG:d0392602-124f-4958-8736-053b13b6a367"}
com.datastax.driver.core.exceptions.InvalidQueryException: Keyspace 'sunbird_courses' does not exist
	at com.datastax.driver.core.exceptions.InvalidQueryException.copy(InvalidQueryException.java:49)
	at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:35)
	at com.datastax.driver.core.Cluster.connect(Cluster.java:334)
	at org.sunbird.helper.CassandraConnectionManagerImpl.getSession(CassandraConnectionManagerImpl.java:37)
	at org.sunbird.cassandraimpl.CassandraOperationImpl.insertRecord(CassandraOperationImpl.java:59)
	at org.sunbird.learner.actors.coursebatch.dao.impl.CourseBatchDaoImpl.create(CourseBatchDaoImpl.java:36)
	at org.sunbird.learner.actors.coursebatch.CourseBatchManagementActor.createCourseBatch(CourseBatchManagementActor.java:119)
	at org.sunbird.learner.actors.coursebatch.CourseBatchManagementActor.onReceive(CourseBatchManagementActor.java:77)
	at org.sunbird.actor.base.BaseActor.onReceive(BaseActor.java:23)
	at akka.actor.UntypedAbstractActor$$anonfun$receive$1.applyOrElse(AbstractActor.scala:337)
	at akka.actor.Actor$class.aroundReceive(Actor.scala:539)
	at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:226)
	at akka.actor.ActorCell.receiveMessage(ActorCell.scala:610)
	at akka.actor.ActorCell.invoke(ActorCell.scala:579)
	at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:268)
	at akka.dispatch.Mailbox.run(Mailbox.scala:229)
	at akka.dispatch.Mailbox.exec(Mailbox.scala:241)
	at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
	at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
	at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
	at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: com.datastax.driver.core.exceptions.InvalidQueryException: Keyspace 'sunbird_courses' does not exist

[ddevadat]

in cassandra this keyspace sunbird_courses doesnt exists

[ddevadat]

which jenkins job do i have to check for this

[aimansharief]

@ddevadat can you please check if there is a job with this name -cassandra_db_update

[ddevadat]

there are two jenkins job deployed

deploy/kubernetes/cassadradbupdate

PLAY [cassandra] ***************************************************************

TASK [Gathering Facts] *********************************************************
ok: [xxxxx]

TASK [cassandra-db-update : set_fact] ******************************************
ok: [xxxxx]

TASK [cassandra-db-update : Make sure cassandra is up and listening] ***********
ok: [xxxxx]

TASK [cassandra-db-update : Copy cql script] ***********************************
changed: [xxxxx] => (item=alter_externalId_table.cql)
changed: [xxxxx] => (item=alter_user_feed_table.cql)

TASK [cassandra-db-update : run cql] *******************************************
changed: [xxxxx] => (item=alter_externalId_table.cql)
changed: [xxxxx] => (item=alter_user_feed_table.cql)

TASK [cassandra-db-update : remove cql file] ***********************************
changed: [xxxxx] => (item=alter_externalId_table.cql)
changed: [xxxxx] => (item=alter_user_feed_table.cql)

PLAY RECAP *********************************************************************
xxxxx    

and deploy/kp/cassandradbupdate

PLAY [cassandra] ***************************************************************

TASK [Gathering Facts] *********************************************************
ok: [xxxxx]

TASK [cassandra-db-update : Make sure cassandra is up and listening] ***********
ok: [xxxxx]

TASK [cassandra-db-update : Copy DB script] ************************************
changed: [xxxxx] => (item=data.cql)
changed: [xxxxx] => (item=dialcode.cql)
changed: [xxxxx] => (item=uci.cql)

TASK [cassandra-db-update : run cql] *******************************************
changed: [xxxxx] => (item=data.cql)
changed: [xxxxx] => (item=dialcode.cql)
changed: [xxxxx] => (item=uci.cql)

PLAY RECAP *********************************************************************
xxxxx                  : ok=4    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0  

[aimansharief]

Are there any other jobs related to cassandra which are not triggered?

[ddevadat]

in the core/provision/cassandra job, i see this message. The job was successful

TASK [cassandra-cql-update : Run the application] ******************************
changed: [10.11.2.8] => {
    "changed": true,
    "cmd": [
        "java",
        "-cp",
        "cassandra-migration-0.0.1-SNAPSHOT-jar-with-dependencies.jar",
        "com.contrastsecurity.cassandra.migration.utils.MigrationScriptEntryPoint"
    ],
    "delta": "0:00:06.059452",
    "end": "2025-03-18 01:44:12.876412",
    "rc": 0,
    "start": "2025-03-18 01:44:06.816960"
}

STDOUT:

Migration started at ==1742262246855
Cassandra Migration 0.0.1-SNAPSHOT by Contrast Security
Connected to cluster: Test Cluster
Data center: datacenter1; Host: /10.11.2.8
Current version of keyspace sunbird: << Empty Schema >>
Migrating keyspace sunbird to version 1.1 - cassandra
Migrating keyspace sunbird to version 1.2 - cassandra
ERROR: Migration of keyspace sunbird to version 1.2 failed! Please restore backups and roll back database and code!
Migration Completed at ==1742262251871


STDERR:

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
com.contrastsecurity.cassandra.migration.CassandraMigrationException: Unable to apply migration
	at com.contrastsecurity.cassandra.migration.action.Migrate.applyMigration(Migrate.java:147)
	at com.contrastsecurity.cassandra.migration.action.Migrate.run(Migrate.java:112)
	at com.contrastsecurity.cassandra.migration.CassandraMigration$1.execute(CassandraMigration.java:88)
	at com.contrastsecurity.cassandra.migration.CassandraMigration$1.execute(CassandraMigration.java:72)
	at com.contrastsecurity.cassandra.migration.CassandraMigration.execute(CassandraMigration.java:201)
	at com.contrastsecurity.cassandra.migration.CassandraMigration.migrate(CassandraMigration.java:71)
	at com.contrastsecurity.cassandra.migration.utils.MigrationScriptEntryPoint.main(MigrationScriptEntryPoint.java:40)
Caused by: com.datastax.driver.core.exceptions.InvalidConfigurationInQueryException: Keyspace sunbirdplugin doesn't exist
	at com.datastax.driver.core.exceptions.InvalidConfigurationInQueryException.copy(InvalidConfigurationInQueryException.java:37)
	at com.datastax.driver.core.exceptions.InvalidConfigurationInQueryException.copy(InvalidConfigurationInQueryException.java:27)
	at com.datastax.driver.core.DriverThrowables.propagateCause(DriverThrowables.java:37)
	at com.datastax.driver.core.DefaultResultSetFuture.getUninterruptibly(DefaultResultSetFuture.java:245)
	at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:63)
	at com.datastax.driver.core.AbstractSession.execute(AbstractSession.java:39)
	at com.contrastsecurity.cassandra.migration.script.CqlScript.execute(CqlScript.java:87)
	at com.contrastsecurity.cassandra.migration.resolver.cql.CqlMigrationExecutor.execute(CqlMigrationExecutor.java:35)
	at com.contrastsecurity.cassandra.migration.action.Migrate.applyMigration(Migrate.java:145)
	... 6 more

[aimansharief]

@ddevadat can you please use the build tag version mentioned here [For Cassandra Migration].
https://lern.sunbird.org/use/release-notes/release-v-7.0.0

[ddevadat]

Build/core/cassandra was run using release-7.0.0_RC3
Deploy/kubernetes/cassandra was run using release-7.0.0, cassandra_keyspace_to_migrate=sunbird ...Below is the output from the deployment job

STDOUT:

Migration started at ==1742777775414
Cassandra Migration 0.0.1-SNAPSHOT by Contrast Security
Connected to cluster: Test Cluster
Data center: datacenter1; Host: /10.11.2.8
Current version of keyspace sunbird: 1.1
Migrating keyspace sunbird to version 1.3 - cassandra
Migrating keyspace sunbird to version 1.4 - cassandra
Migrating keyspace sunbird to version 1.5 - cassandra
Migrating keyspace sunbird to version 1.6 - cassandra
Migrating keyspace sunbird to version 1.7 - cassandra
Migrating keyspace sunbird to version 1.8 - cassandra
Migrating keyspace sunbird to version 1.9 - cassandra
Migrating keyspace sunbird to version 1.10 - cassandra
Migrating keyspace sunbird to version 1.11 - cassandra
Migrating keyspace sunbird to version 1.12 - cassandra
Migrating keyspace sunbird to version 1.13 - cassandra
Migrating keyspace sunbird to version 1.14 - cassandra
Migrating keyspace sunbird to version 1.15 - cassandra
Migrating keyspace sunbird to version 1.16 - cassandra
Migrating keyspace sunbird to version 1.17 - cassandra
Migrating keyspace sunbird to version 1.18 - cassandra
Migrating keyspace sunbird to version 1.19 - cassandra
Migrating keyspace sunbird to version 1.20 - cassandra
Migrating keyspace sunbird to version 1.21 - cassandra
Migrating keyspace sunbird to version 1.22 - cassandra
Migrating keyspace sunbird to version 1.23 - cassandra
Migrating keyspace sunbird to version 1.24 - cassandra
Migrating keyspace sunbird to version 1.25 - cassandra
Migrating keyspace sunbird to version 1.26 - cassandra
Migrating keyspace sunbird to version 1.27 - cassandra
Migrating keyspace sunbird to version 1.29 - cassandra
Migrating keyspace sunbird to version 1.30 - cassandra
Migrating keyspace sunbird to version 1.31 - cassandra
Migrating keyspace sunbird to version 1.32 - cassandra
Migrating keyspace sunbird to version 1.33 - cassandra
Migrating keyspace sunbird to version 1.34 - cassandra
Migrating keyspace sunbird to version 1.35 - cassandra
Migrating keyspace sunbird to version 1.36 - cassandra
Migrating keyspace sunbird to version 1.37 - cassandra
Migrating keyspace sunbird to version 1.38 - cassandra
Migrating keyspace sunbird to version 1.39 - cassandra
Migrating keyspace sunbird to version 1.40 - cassandra
Migrating keyspace sunbird to version 1.42 - cassandra
Migrating keyspace sunbird to version 1.43 - cassandra
Migrating keyspace sunbird to version 1.44 - cassandra
Migrating keyspace sunbird to version 1.45 - cassandra
Migrating keyspace sunbird to version 1.46 - cassandra
Migrating keyspace sunbird to version 1.47 - cassandra
Migrating keyspace sunbird to version 1.48 - cassandra
Migrating keyspace sunbird to version 1.49 - cassandra
Migrating keyspace sunbird to version 1.53 - cassandra
Migrating keyspace sunbird to version 1.54 - cassandra
Migrating keyspace sunbird to version 1.55 - cassandra
Migrating keyspace sunbird to version 1.56 - cassandra
Migrating keyspace sunbird to version 1.58 - cassandra
Migrating keyspace sunbird to version 1.60 - cassandra
Migrating keyspace sunbird to version 1.61 - cassandra
Migrating keyspace sunbird to version 1.62 - cassandra
Migrating keyspace sunbird to version 1.63 - cassandra
Migrating keyspace sunbird to version 1.64 - cassandra
Migrating keyspace sunbird to version 1.65 - cassandra
Migrating keyspace sunbird to version 1.67 - cassandra
Migrating keyspace sunbird to version 1.68 - cassandra
Migrating keyspace sunbird to version 1.69 - cassandra
Migrating keyspace sunbird to version 1.70 - cassandra
Migrating keyspace sunbird to version 1.71 - cassandra
Migrating keyspace sunbird to version 1.72 - cassandra
Migrating keyspace sunbird to version 1.74 - cassandra
Migrating keyspace sunbird to version 1.75 - cassandra
Migrating keyspace sunbird to version 1.76 - cassandra
Migrating keyspace sunbird to version 1.78 - cassandra
Migrating keyspace sunbird to version 1.79 - cassandra
Migrating keyspace sunbird to version 1.80 - cassandra
Migrating keyspace sunbird to version 1.83 - cassandra
Migrating keyspace sunbird to version 1.84 - cassandra
Migrating keyspace sunbird to version 1.85 - cassandra
Migrating keyspace sunbird to version 1.88 - cassandra
Migrating keyspace sunbird to version 1.89 - cassandra
Migrating keyspace sunbird to version 1.90 - cassandra
Migrating keyspace sunbird to version 1.91 - cassandra
Migrating keyspace sunbird to version 1.92 - cassandra
Migrating keyspace sunbird to version 1.93 - cassandra
Migrating keyspace sunbird to version 1.94 - cassandra
Migrating keyspace sunbird to version 1.95 - cassandra
Migrating keyspace sunbird to version 1.96 - cassandra
Migrating keyspace sunbird to version 1.97 - cassandra
Migrating keyspace sunbird to version 1.98 - cassandra
Migrating keyspace sunbird to version 1.99 - cassandra
Migrating keyspace sunbird to version 1.100 - cassandra
Migrating keyspace sunbird to version 1.101 - cassandra
Migrating keyspace sunbird to version 1.104 - cassandra
Migrating keyspace sunbird to version 1.105 - cassandra
Migrating keyspace sunbird to version 1.106 - cassandra
Migrating keyspace sunbird to version 1.107 - cassandra
Migrating keyspace sunbird to version 1.110 - cassandra
Migrating keyspace sunbird to version 1.111 - cassandra
Migrating keyspace sunbird to version 1.113 - cassandra
Migrating keyspace sunbird to version 1.116 - cassandra
Migrating keyspace sunbird to version 1.117 - cassandra
Migrating keyspace sunbird to version 1.118 - cassandra
Migrating keyspace sunbird to version 1.119 - cassandra
Migrating keyspace sunbird to version 1.120 - cassandra
Migrating keyspace sunbird to version 1.121 - cassandra
Migrating keyspace sunbird to version 1.122 - cassandra
Migrating keyspace sunbird to version 1.123 - cassandra
Migrating keyspace sunbird to version 1.124 - cassandra
Migrating keyspace sunbird to version 1.127 - cassandra
Migrating keyspace sunbird to version 1.133 - cassandra
Migrating keyspace sunbird to version 1.134 - cassandra
Migrating keyspace sunbird to version 1.135 - cassandra
Migrating keyspace sunbird to version 1.137 - cassandra
Migrating keyspace sunbird to version 1.139 - cassandra
Migrating keyspace sunbird to version 1.143 - cassandra
Migrating keyspace sunbird to version 1.144 - cassandra
Migrating keyspace sunbird to version 1.146 - cassandra
Successfully applied 110 migrations to keyspace sunbird (execution time 03:25.610s).
Migration Completed at ==1742777983761


STDERR:

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.

[jeraldfernandes28]

@ddevadat @aimansharief Is this issue resolved or yet to be resolved. Please let me know.