REGARDING_api_z1/0_CANARY_UPDATE


Parthiban Annadurai <senjiparthi@...>
 

Hello All,
Since, I was facing the following issue for very long time, I have opened it as a separate thread. The problem am currently facing is

Error 400007: `api_z1/0' is not running after update

I have SSHed into the api_z1/0 VM and did a monit summary. It shows that

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Could anyone help on this issue? Thanks.


CF Runtime
 

Have you checked the control script logs in the `/var/vcap/sys/log/`
folder? If the jobs are failing to start that's a good place to start. If
you send them to us we can tell you more.

Also, what infrastructure are you deploying cloud foundry to, and can you
send us the manifest you're using to deploy it?

Natalie & Mikhail
OSS Integration & Runtime

On Thu, Nov 19, 2015 at 1:19 AM, Parthiban A <senjiparthi(a)gmail.com> wrote:

Hello All,
Since, I was facing the following issue for very long time,
I have opened it as a separate thread. The problem am currently facing is

Error 400007: `api_z1/0' is not running after update

I have SSHed into the api_z1/0 VM and did a monit summary. It shows that

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Could anyone help on this issue? Thanks.


Parthiban Annadurai <senjiparthi@...>
 

Hello Natalie & Mikhail,

FYI, am trying to deploy Cloud Foundry on
vSphere. I have shared the Manifest too with this mail. Thanks..

On 25 November 2015 at 04:41, CF Runtime <cfruntime(a)gmail.com> wrote:

Have you checked the control script logs in the `/var/vcap/sys/log/`
folder? If the jobs are failing to start that's a good place to start. If
you send them to us we can tell you more.

Also, what infrastructure are you deploying cloud foundry to, and can you
send us the manifest you're using to deploy it?

Natalie & Mikhail
OSS Integration & Runtime

On Thu, Nov 19, 2015 at 1:19 AM, Parthiban A <senjiparthi(a)gmail.com>
wrote:

Hello All,
Since, I was facing the following issue for very long time,
I have opened it as a separate thread. The problem am currently facing is

Error 400007: `api_z1/0' is not running after update

I have SSHed into the api_z1/0 VM and did a monit summary. It shows that

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit
summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Could anyone help on this issue? Thanks.


CF Runtime
 

Hi, Parthiban!

Thanks for the manifest!
Can you please also attached the logs and error logs of control script?
Logs can be found in the `/var/vcap/sys/log/` folder.

Thanks!

On Wed, Nov 25, 2015 at 4:43 AM, Parthiban Annadurai <senjiparthi(a)gmail.com>
wrote:

Hello Natalie & Mikhail,

FYI, am trying to deploy Cloud Foundry
on vSphere. I have shared the Manifest too with this mail. Thanks..


On 25 November 2015 at 04:41, CF Runtime <cfruntime(a)gmail.com> wrote:

Have you checked the control script logs in the `/var/vcap/sys/log/`
folder? If the jobs are failing to start that's a good place to start. If
you send them to us we can tell you more.

Also, what infrastructure are you deploying cloud foundry to, and can you
send us the manifest you're using to deploy it?

Natalie & Mikhail
OSS Integration & Runtime

On Thu, Nov 19, 2015 at 1:19 AM, Parthiban A <senjiparthi(a)gmail.com>
wrote:

Hello All,
Since, I was facing the following issue for very long
time, I have opened it as a separate thread. The problem am currently
facing is

Error 400007: `api_z1/0' is not running after update

I have SSHed into the api_z1/0 VM and did a monit summary. It shows that

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit
summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Could anyone help on this issue? Thanks.


Parthiban Annadurai <senjiparthi@...>
 

Hi,
The var/vcap/sys/log shows the following,

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Also I have checked for cloud_controller_ng_ctl.log, it has the following,

[2015-11-18 04:33:34+0000] ------------ STARTING cloud_controller_ng_ctl at
Wed Nov 18 04:32:53 UTC 2015 --------------
[2015-11-18 04:33:34+0000] Preparing local package directory
[2015-11-18 04:33:34+0000] Preparing local resource_pool directory
[2015-11-18 04:33:34+0000] Preparing local droplet directory
[2015-11-18 04:33:34+0000] Deprecated: Use -s or --insert-seed flag
[2015-11-18 04:33:34+0000] Killing
/var/vcap/sys/run/cloud_controller_ng/cloud_controller_ng.pid: 32522
[2015-11-18 04:33:34+0000] .Stopped


Then, nfs_mounter_ctl.log has the following,

[2015-11-18 04:27:20+0000] Found NFS mount, unmounting...
[2015-11-18 04:27:20+0000] NFS unmounted
[2015-11-18 04:27:20+0000] idmapd start/post-stop, process 25777
[2015-11-18 04:27:20+0000] NFS unmounted
[2015-11-18 04:27:20+0000] Mounting NFS...
[2015-11-18 04:27:20+0000] mount.nfs: timeout set for Wed Nov 18 04:29:20
2015
[2015-11-18 04:27:20+0000] mount.nfs: trying text-based options
'timeo=10,intr,lookupcache=positive,vers=4,addr=192.168.33.53,clientaddr=192.168.33.184'
[2015-11-18 04:27:20+0000] mount.nfs: trying text-based options
'timeo=10,intr,lookupcache=positive,addr=192.168.33.53'
[2015-11-18 04:27:20+0000] mount.nfs: prog 100003, trying vers=3, prot=6
[2015-11-18 04:27:20+0000] mount.nfs: prog 100005, trying vers=3, prot=17
[2015-11-18 04:27:20+0000] Failed to start: cannot write to NFS

I think the problem is with the NFS. Could you please help on this issue??
Thanks..

On 25 November 2015 at 23:59, CF Runtime <cfruntime(a)gmail.com> wrote:

Hi, Parthiban!

Thanks for the manifest!
Can you please also attached the logs and error logs of control script?
Logs can be found in the `/var/vcap/sys/log/` folder.

Thanks!

On Wed, Nov 25, 2015 at 4:43 AM, Parthiban Annadurai <
senjiparthi(a)gmail.com> wrote:

Hello Natalie & Mikhail,

FYI, am trying to deploy Cloud Foundry
on vSphere. I have shared the Manifest too with this mail. Thanks..


On 25 November 2015 at 04:41, CF Runtime <cfruntime(a)gmail.com> wrote:

Have you checked the control script logs in the `/var/vcap/sys/log/`
folder? If the jobs are failing to start that's a good place to start. If
you send them to us we can tell you more.

Also, what infrastructure are you deploying cloud foundry to, and can
you send us the manifest you're using to deploy it?

Natalie & Mikhail
OSS Integration & Runtime

On Thu, Nov 19, 2015 at 1:19 AM, Parthiban A <senjiparthi(a)gmail.com>
wrote:

Hello All,
Since, I was facing the following issue for very long
time, I have opened it as a separate thread. The problem am currently
facing is

Error 400007: `api_z1/0' is not running after update

I have SSHed into the api_z1/0 VM and did a monit summary. It shows that

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit
summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Could anyone help on this issue? Thanks.


Amit Kumar Gupta
 

Hi Parthiban,

Looks like you're discussing the exact same issue here:
https://lists.cloudfoundry.org/archives/list/cf-dev(a)lists.cloudfoundry.org/thread/GZWT445VL4Y4WSH6K2Y2I4R5WA5AB665/.
Anybody trying to help out with this problem, please do so on that other
thread, so we don't duplicate effort.

Thanks,
Amit

On Thu, Nov 26, 2015 at 6:43 AM, Parthiban Annadurai <senjiparthi(a)gmail.com>
wrote:

Hi,
The var/vcap/sys/log shows the following,

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Also I have checked for cloud_controller_ng_ctl.log, it has the following,

[2015-11-18 04:33:34+0000] ------------ STARTING cloud_controller_ng_ctl
at Wed Nov 18 04:32:53 UTC 2015 --------------
[2015-11-18 04:33:34+0000] Preparing local package directory
[2015-11-18 04:33:34+0000] Preparing local resource_pool directory
[2015-11-18 04:33:34+0000] Preparing local droplet directory
[2015-11-18 04:33:34+0000] Deprecated: Use -s or --insert-seed flag
[2015-11-18 04:33:34+0000] Killing
/var/vcap/sys/run/cloud_controller_ng/cloud_controller_ng.pid: 32522
[2015-11-18 04:33:34+0000] .Stopped


Then, nfs_mounter_ctl.log has the following,

[2015-11-18 04:27:20+0000] Found NFS mount, unmounting...
[2015-11-18 04:27:20+0000] NFS unmounted
[2015-11-18 04:27:20+0000] idmapd start/post-stop, process 25777
[2015-11-18 04:27:20+0000] NFS unmounted
[2015-11-18 04:27:20+0000] Mounting NFS...
[2015-11-18 04:27:20+0000] mount.nfs: timeout set for Wed Nov 18 04:29:20
2015
[2015-11-18 04:27:20+0000] mount.nfs: trying text-based options
'timeo=10,intr,lookupcache=positive,vers=4,addr=192.168.33.53,clientaddr=192.168.33.184'
[2015-11-18 04:27:20+0000] mount.nfs: trying text-based options
'timeo=10,intr,lookupcache=positive,addr=192.168.33.53'
[2015-11-18 04:27:20+0000] mount.nfs: prog 100003, trying vers=3, prot=6
[2015-11-18 04:27:20+0000] mount.nfs: prog 100005, trying vers=3, prot=17
[2015-11-18 04:27:20+0000] Failed to start: cannot write to NFS

I think the problem is with the NFS. Could you please help on this issue??
Thanks..



On 25 November 2015 at 23:59, CF Runtime <cfruntime(a)gmail.com> wrote:

Hi, Parthiban!

Thanks for the manifest!
Can you please also attached the logs and error logs of control script?
Logs can be found in the `/var/vcap/sys/log/` folder.

Thanks!

On Wed, Nov 25, 2015 at 4:43 AM, Parthiban Annadurai <
senjiparthi(a)gmail.com> wrote:

Hello Natalie & Mikhail,

FYI, am trying to deploy Cloud Foundry
on vSphere. I have shared the Manifest too with this mail. Thanks..


On 25 November 2015 at 04:41, CF Runtime <cfruntime(a)gmail.com> wrote:

Have you checked the control script logs in the `/var/vcap/sys/log/`
folder? If the jobs are failing to start that's a good place to start. If
you send them to us we can tell you more.

Also, what infrastructure are you deploying cloud foundry to, and can
you send us the manifest you're using to deploy it?

Natalie & Mikhail
OSS Integration & Runtime

On Thu, Nov 19, 2015 at 1:19 AM, Parthiban A <senjiparthi(a)gmail.com>
wrote:

Hello All,
Since, I was facing the following issue for very long
time, I have opened it as a separate thread. The problem am currently
facing is

Error 400007: `api_z1/0' is not running after update

I have SSHed into the api_z1/0 VM and did a monit summary. It shows
that

root(a)5c446a3d-3070-4d24-9f2e-1cff18218c07:/var/vcap/sys/log# monit
summary
The Monit daemon 5.2.4 uptime: 20m

Process 'cloud_controller_ng' initializing
Process 'cloud_controller_worker_local_1' not monitored
Process 'cloud_controller_worker_local_2' not monitored
Process 'nginx_cc' initializing
Process 'metron_agent' running
File 'nfs_mounter' Does not exist
System 'system_5c446a3d-3070-4d24-9f2e-1cff18218c07' running

Could anyone help on this issue? Thanks.