Importing database to RDS


Oded Gold
 

Hi all

I am trying to move an existing database from a previous BOSH deployment to RDS. The database is postgres
However when I try run the import I have privilege errors with the SUPER users and applying roles to the vcap user.
Has anyone had a similar problem when migrating to RDS?
Thank you


Dmitriy Kalinin
 

do you when trying to run export? do you have a stacktrace or an error msg?

Sent from my iPhone

On Nov 15, 2015, at 8:03 AM, Oded Gold <oded(a)nurego.com> wrote:

Hi all

I am trying to move an existing database from a previous BOSH deployment to RDS. The database is postgres
However when I try run the import I have privilege errors with the SUPER users and applying roles to the vcap user.
Has anyone had a similar problem when migrating to RDS?
Thank you


Oded Gold
 

The import recreates everything and imports the data the output errors are. I am importing from a database of a previous successful BOSH deployment

ERROR: role "vcap" cannot be dropped because some objects depend on it
DETAIL: privileges for database template1
CREATE ROLE
ERROR: must be superuser to alter superusers
CREATE ROLE
ERROR: must be superuser to alter superusers
ERROR: role "vcap" already exists
ERROR: must be superuser to alter superusers
ERROR: must be member of role "vcap"
ERROR: must be member of role "vcap"
ERROR: must be member of role "vcap"
ERROR: must be member of role "vcap"
REVOKE
REVOKE
GRANT
GRANT
ERROR: must be member of role "vcap"


Dr Nic Williams
 

Can you dump the DB without users/roles?

On Mon, Nov 16, 2015 at 12:08 AM, Oded Gold <oded(a)nurego.com> wrote:

The import recreates everything and imports the data the output errors are. I am importing from a database of a previous successful BOSH deployment
ERROR: role "vcap" cannot be dropped because some objects depend on it
DETAIL: privileges for database template1
CREATE ROLE
ERROR: must be superuser to alter superusers
CREATE ROLE
ERROR: must be superuser to alter superusers
ERROR: role "vcap" already exists
ERROR: must be superuser to alter superusers
ERROR: must be member of role "vcap"
ERROR: must be member of role "vcap"
ERROR: must be member of role "vcap"
ERROR: must be member of role "vcap"
REVOKE
REVOKE
GRANT
GRANT
ERROR: must be member of role "vcap"


Oded Gold
 

I dumped the db with no users and roles like you suggested thanks, RDS doesnt let you import c language functions to my understanding which also caused a problem.

But now I am trying to import the data of a large database and the ssh connection keeps getting closed via the bosh ssh. I tried a few suggested google practices by changing ssd_config. That didnt seem to work, does bosh ssh do something different or use a different config file?


Dr Nic Williams
 

Perhaps install tmux and run the commands inside a tmux session. That way the tmux session will survive the inactive bosh ssh session.

On Tue, Nov 24, 2015 at 1:34 AM, Oded Gold <oded(a)nurego.com> wrote:

I dumped the db with no users and roles like you suggested thanks, RDS doesnt let you import c language functions to my understanding which also caused a problem.
But now I am trying to import the data of a large database and the ssh connection keeps getting closed via the bosh ssh. I tried a few suggested google practices by changing ssd_config. That didnt seem to work, does bosh ssh do something different or use a different config file?


Dmitriy Kalinin
 

That's interesting that changing sshd_config did now work. What did you
change? Did you restart sshd after the change?

On Tue, Nov 24, 2015 at 7:57 AM, Dr Nic Williams <drnicwilliams(a)gmail.com>
wrote:

Perhaps install tmux and run the commands inside a tmux session. That way
the tmux session will survive the inactive bosh ssh session.




On Tue, Nov 24, 2015 at 1:34 AM, Oded Gold <oded(a)nurego.com> wrote:

I dumped the db with no users and roles like you suggested thanks, RDS
doesnt let you import c language functions to my understanding which also
caused a problem.

But now I am trying to import the data of a large database and the ssh
connection keeps getting closed via the bosh ssh. I tried a few suggested
google practices by changing ssd_config. That didnt seem to work, does bosh
ssh do something different or use a different config file?


Oded Gold
 

I have been experiencing other unexpected things with the bosh for instance is I run bosh stop <> it says it stops the aws instance but it actually doesn't , I can still see the instance running bosh ssh <> doesn't ask for a one time password like it used to plus a one or two others. Could this be related? Did I maybe not set up the bosh correctly?


Dmitriy Kalinin
 

bosh stop stops the processes on the machine, not the VM in the iaas. there is --hard option to delete the vm.

we have improved bosh ssh command to stop asking for the password. user now has passwordless sudo access on recent stemcells.

Sent from my iPhone

On Nov 26, 2015, at 7:15 AM, Oded Gold <oded(a)nurego.com> wrote:

I have been experiencing other unexpected things with the bosh for instance is I run bosh stop <> it says it stops the aws instance but it actually doesn't , I can still see the instance running bosh ssh <> doesn't ask for a one time password like it used to plus a one or two others. Could this be related? Did I maybe not set up the bosh correctly?