Re: - Urgent - Cloud Foundry Deployment is failing on dea.yml.erb


Kinjal Doshi
 

Hi Gwenn,

Thanks a lot for the quick response.

Apologies, will refrain from putting Urgent going forward.

Please find below the manifest file:

# The following line helps maintain current documentation at
http://docs.cloudfoundry.org.
# code_snippet cf-minimal-aws start
---
name: cf
director_uuid: e962881a-7713-42b2-b5ce-fead8d01d26e

releases:
- {name: cf, version: latest}

networks:
- name: cf_private
type: manual
subnets:
- range: 10.0.16.0/24
gateway: 10.0.16.1
dns: [10.0.0.2]
reserved: ["10.0.16.2 - 10.0.16.3"]
static: ["10.0.16.100 - 10.0.16.105"]
cloud_properties:
subnet: subnet-d72433fc

- name: cf_public
type: manual
subnets:
- range: 10.0.0.0/24
gateway: 10.0.0.1
dns: [10.0.0.2]
reserved: ["10.0.0.2 - 10.0.0.10"]
cloud_properties:
subnet: subnet-d30510f8
security_groups:
- cf
- bosh

- name: elastic
type: vip
cloud_properties: {}

resource_pools:
- name: small_z1
network: cf_private
stemcell:
name: bosh-aws-xen-hvm-ubuntu-trusty-go_agent
version: 3147
cloud_properties:
availability_zone: us-east-1b
instance_type: c3.large

compilation:
workers: 6
network: cf_private
reuse_compilation_vms: true
cloud_properties:
availability_zone: us-east-1b
instance_type: c3.large

update:
canaries: 1
max_in_flight: 1
serial: false
canary_watch_time: 30000-600000
update_watch_time: 5000-600000

jobs:
- name: nats_z1
instances: 1
resource_pool: small_z1
templates:
- {name: nats, release: cf}
- {name: nats_stream_forwarder, release: cf}
- {name: metron_agent, release: cf}
networks:
- name: cf_private
static_ips: [10.0.16.103]

- name: etcd_z1
instances: 1
resource_pool: small_z1
persistent_disk: 102400
templates:
- {name: etcd, release: cf}
- {name: etcd_metrics_server, release: cf}
- {name: metron_agent, release: cf}
networks:
- name: cf_private
static_ips: [10.0.16.104]
properties:
etcd_metrics_server:
nats:
machines: [10.0.16.103]
password: c1oudc0w
username: nats

- name: nfs_z1
instances: 1
persistent_disk: 102400
resource_pool: small_z1
templates:
- {name: debian_nfs_server, release: cf}
- {name: metron_agent, release: cf}
networks:
- name: cf_private
static_ips: [10.0.16.105]

- name: postgres_z1
instances: 1
persistent_disk: 1024
resource_pool: small_z1
templates:
- {name: postgres, release: cf}
- {name: metron_agent, release: cf}
networks:
- name: cf_private
static_ips: [10.0.16.101]
update:
serial: true

- name: api_z1
instances: 1
resource_pool: small_z1
templates:
- {name: cloud_controller_ng, release: cf}
- {name: cloud_controller_worker, release: cf}
- {name: cloud_controller_clock, release: cf}
- {name: metron_agent, release: cf}
- {name: nfs_mounter, release: cf}
- {name: route_registrar, release: cf}
networks:
- name: cf_private
properties:
nfs_server:
address: 10.0.16.105
allow_from_entries: [10.0.16.0/24]
route_registrar:
routes:
- name: api
port: 9022
uris:
- "api.53.62.110.98.xip.io"

- name: ha_proxy_z1
instances: 1
resource_pool: small_z1
templates:
- {name: haproxy, release: cf}
- {name: metron_agent, release: cf}
networks:
- name: elastic
static_ips: [53.62.110.98]
- name: cf_public
default: [gateway, dns]
properties:
ha_proxy:
ssl_pem: |
-----BEGIN CERTIFICATE-----
MIICozCCAgwCCQC53VtTCiZvljANBgkqhkiG9w0BAQsFADCBlTELMAkGA1UEBhMC
SU4xEjAQBgNVBAgMCUthcm5hdGFrYTESMBAGA1UEBwwJQmFuZ2Fsb3JlMRIwEAYD
VQQKDAlBY2NlbnR1cmUxDDAKBgNVBAsMA0FDTjERMA8GA1UEAwwIKi54aXAuaW8x
KTAnBgkqhkiG9w0BCQEWGmtpbmphbC5kb3NoaUBhY2NlbnR1cmUuY29tMB4XDTE1
MTIwNzExMzQ0M1oXDTE2MDEwNjExMzQ0M1owgZUxCzAJBgNVBAYTAklOMRIwEAYD
VQQIDAlLYXJuYXRha2ExEjAQBgNVBAcMCUJhbmdhbG9yZTESMBAGA1UECgwJQWNj
ZW50dXJlMQwwCgYDVQQLDANBQ04xETAPBgNVBAMMCCoueGlwLmlvMSkwJwYJKoZI
hvcNAQkBFhpraW5qYWwuZG9zaGlAYWNjZW50dXJlLmNvbTCBnzANBgkqhkiG9w0B
AQEFAAOBjQAwgYkCgYEAnEoZ3cKLUdjPkmgt02BW5AjHtAqykJBGDVy5ER9iLjob
AmKpt9MxaP/Oq53tlzzeQxZTP5+CNEHEaLDVql2AEdT2AITUfPu1S+sg2oPANL66
rgOrTYTgAMxHo5nDCYp5vsLTVMiCnVUOQs+F66NBoOJgqzHXD4EHLA9BM/V3wx8C
AwEAATANBgkqhkiG9w0BAQsFAAOBgQBtToBAVZn2NaJBUUVK686AkHQvyT36yfln
QhCIJqZSVU7VLREOfn9G8hNOBzQ4llLdME7JNCJPpyyqZnahIv5S7tRBc0W6MXxo
YOB/sL9jrFH9FztMw4a7h6pOS2SFusyd8kWJJSj+vtjwcNIwz+Nu9HgoNPD3NSbB
uAMVhBjfYA==
-----END CERTIFICATE-----
-----BEGIN RSA PRIVATE KEY-----
MIICWwIBAAKBgQCcShndwotR2M+SaC3TYFbkCMe0CrKQkEYNXLkRH2IuOhsCYqm3
0zFo/86rne2XPN5DFlM/n4I0QcRosNWqXYAR1PYAhNR8+7VL6yDag8A0vrquA6tN
hOAAzEejmcMJinm+wtNUyIKdVQ5Cz4Xro0Gg4mCrMdcPgQcsD0Ez9XfDHwIDAQAB
AoGAbJeQIWVrKBNdJnz8WkI2HXt8RryoFYopIl+qtxr3POdinOWwxukXC72x+8xf
qRXB2RtJ/Ir4DRclQRidXSJaOPOQe5d5U9pAK4RYDWboejLu0n9rq5ecGPEhBv79
JXeK2sl+rq0Fzq0L+4rPHbnk8MuqaFuZ+6O6hJRjtNggagECQQDNShe8IkrvAlDm
b7NP4vIx2tyeQmDvZiJn8gER8M7tpwhmczrElcb+nphlxTT6i0zFJp95rywHdviA
Dk+3fn3JAkEAwuVkgvTgFZTnkEaNNnCX2XYvZ5Q38bjrz2jturXHigWFfjvONgCm
jsaChtZA8+VnFyMV8KG7MJQcztZex0yNpwJAKl9LrNpLKzAIMLgHg8qtANtSxBuh
VGh5W4kY7XIN1AGw+yx3idH8Y9uqSv88YyZTbzH8oqokZVoKCqxpic9C+QJAaoIA
Ds0R1Nl+Pss/iru3UGEVAO7wL8pWHBAEst96f4QK8vRt+fcbDrWPSW63KlJ4px1G
dS19ZcvbfnGKdDHyywJAZWtCLWn6EQPShpoDiIhMTX5YhSu2WCfIE+83dBuWx/SW
dCa0SQrHP4vW5sQFHBDzKVk4f7otN6kbvnJXCCG3ZA==
-----END RSA PRIVATE KEY-----
router:
servers:
z1: [10.0.16.102]

- name: hm9000_z1
instances: 1
resource_pool: small_z1
templates:
- {name: hm9000, release: cf}
- {name: metron_agent, release: cf}
- {name: route_registrar, release: cf}
networks:
- name: cf_private
properties:
route_registrar:
routes:
- name: hm9000
port: 5155
uris:
- "hm9000.53.62.110.98.xip.io"

- name: doppler_z1
instances: 1
resource_pool: small_z1
templates:
- {name: doppler, release: cf}
networks:
- name: cf_private
properties:
doppler: {zone: z1}
doppler_endpoint:
shared_secret: c1oudc0w

- name: loggregator_trafficcontroller_z1
instances: 1
resource_pool: small_z1
templates:
- {name: loggregator_trafficcontroller, release: cf}
- {name: metron_agent, release: cf}
- {name: route_registrar, release: cf}
networks:
- name: cf_private
properties:
traffic_controller: {zone: z1}
route_registrar:
routes:
- name: doppler
port: 8081
uris:
- "doppler.53.62.110.98.xip.io"
- name: loggregator
port: 8080
uris:
- "loggregator.53.62.110.98.xip.io"

- name: uaa_z1
instances: 1
resource_pool: small_z1
templates:
- {name: uaa, release: cf}
- {name: metron_agent, release: cf}
- {name: route_registrar, release: cf}
networks:
- name: cf_private
properties:
login:
catalina_opts: -Xmx768m -XX:MaxPermSize=256m
route_registrar:
routes:
- name: uaa
port: 8080
uris:
- "uaa.53.62.110.98.xip.io"
- "*.uaa.53.62.110.98.xip.io"
- "login.53.62.110.98.xip.io"
- "*.login.53.62.110.98.xip.io"
uaa:
admin:
client_secret: c1oudc0w
batch:
password: c1oudc0w
username: batch_user
cc:
client_secret: c1oudc0w
scim:
userids_enabled: true
users:
-
admin|c1oudc0w|scim.write,scim.read,openid,cloud_controller.admin,doppler.firehose,routing.router_groups.read
uaadb:
address: 10.0.16.101
databases:
- {name: uaadb, tag: uaa}
db_scheme: postgresql
port: 5524
roles:
- {name: uaaadmin, password: c1oudc0w, tag: admin}

- name: router_z1
instances: 1
resource_pool: small_z1
templates:
- {name: gorouter, release: cf}
- {name: metron_agent, release: cf}
networks:
- name: cf_private
static_ips: [10.0.16.102]
properties:
dropsonde: {enabled: true}

- name: runner_z1
instances: 1
resource_pool: small_z1
templates:
- {name: dea_next, release: cf}
- {name: dea_logging_agent, release: cf}
- {name: metron_agent, release: cf}
networks:
- name: cf_private
properties:
dea_next: {zone: z1}

properties:
networks: {apps: cf_private}
app_domains: [53.62.110.98.xip.io]
cc:
allow_app_ssh_access: false
bulk_api_password: c1oudc0w
db_encryption_key: c1oudc0w
default_running_security_groups: [public_networks, dns]
default_staging_security_groups: [public_networks, dns]
install_buildpacks:
- {name: java_buildpack, package: buildpack_java}
- {name: ruby_buildpack, package: buildpack_ruby}
- {name: nodejs_buildpack, package: buildpack_nodejs}
- {name: go_buildpack, package: buildpack_go}
- {name: python_buildpack, package: buildpack_python}
- {name: php_buildpack, package: buildpack_php}
- {name: staticfile_buildpack, package: buildpack_staticfile}
- {name: binary_buildpack, package: buildpack_binary}
internal_api_user: internal_user
internal_api_password: c1oudc0w
quota_definitions:
default:
memory_limit: 102400
non_basic_services_allowed: true
total_routes: 1000
total_services: -1
security_group_definitions:
- name: public_networks
rules:
- {destination: 0.0.0.0-9.255.255.255, protocol: all}
- {destination: 11.0.0.0-169.253.255.255, protocol: all}
- {destination: 169.255.0.0-172.15.255.255, protocol: all}
- {destination: 172.32.0.0-192.167.255.255, protocol: all}
- {destination: 192.169.0.0-255.255.255.255, protocol: all}
- name: dns
rules:
- {destination: 0.0.0.0/0, ports: '53', protocol: tcp}
- {destination: 0.0.0.0/0, ports: '53', protocol: udp}
srv_api_uri: http://api.53.62.110.98.xip.io
staging_upload_password: c1oudc0w
staging_upload_user: staging_upload_user
ccdb:
address: 10.0.16.101
databases:
- {name: ccdb, tag: cc}
db_scheme: postgres
port: 5524
roles:
- {name: ccadmin, password: c1oudc0w, tag: admin}
databases:
databases:
- {name: ccdb, tag: cc, citext: true}
- {name: uaadb, tag: uaa, citext: true}
port: 5524
roles:
- {name: ccadmin, password: c1oudc0w, tag: admin}
- {name: uaaadmin, password: c1oudc0w, tag: admin}
dea_next:
advertise_interval_in_seconds: 5
heartbeat_interval_in_seconds: 10
memory_mb: 33996
description: Cloud Foundry sponsored by Pivotal
domain: 53.62.110.98.xip.io
etcd:
machines: [10.0.16.104]
peer_require_ssl: false
require_ssl: false
hm9000:
url: http://hm9000.53.62.110.98.xip.io
logger_endpoint:
port: 4443
loggregator:
etcd:
machines: [10.0.16.104]
loggregator_endpoint:
shared_secret: c1oudc0w
login:
protocol: http
metron_agent:
zone: z1
deployment: minimal-aws
metron_endpoint:
shared_secret: c1oudc0w
nats:
machines: [10.0.16.103]
password: c1oudc0w
port: 4222
user: nats
nfs_server:
address: 10.0.16.105
allow_from_entries: [10.0.16.0/24]
ssl:
skip_cert_verify: true
system_domain: 53.62.110.98.xip.io
system_domain_organization: default_organization
uaa:
clients:
cc-service-dashboards:
authorities: clients.read,clients.write,clients.admin
authorized-grant-types: client_credentials
scope: openid,cloud_controller_service_permissions.read
secret: c1oudc0w
cloud_controller_username_lookup:
authorities: scim.userids
authorized-grant-types: client_credentials
secret: c1oudc0w
cc_routing:
authorities: routing.router_groups.read
secret: c1oudc0w
authorized-grant-types: client_credentials
gorouter:
authorities:
clients.read,clients.write,clients.admin,routing.routes.write,routing.routes.read
authorized-grant-types: client_credentials,refresh_token
scope: openid,cloud_controller_service_permissions.read
secret: c1oudc0w
doppler:
authorities: uaa.resource
secret: c1oudc0w
login:
authorities:
oauth.login,scim.write,clients.read,notifications.write,critical_notifications.write,emails.write,scim.userids,password.write
authorized-grant-types:
authorization_code,client_credentials,refresh_token
redirect-uri: http://login.53.62.110.98.xip.io
scope: openid,oauth.approvals
secret: c1oudc0w
servicesmgmt:
authorities:
uaa.resource,oauth.service,clients.read,clients.write,clients.secret
authorized-grant-types:
authorization_code,client_credentials,password,implicit
autoapprove: true
redirect-uri:
http://servicesmgmt.53.62.110.98.xip.io/auth/cloudfoundry/callback
scope: openid,cloud_controller.read,cloud_controller.write
secret: c1oudc0w
jwt:
signing_key: |
-----BEGIN RSA PRIVATE KEY-----
MIICXAIBAAKBgQDHFr+KICms+tuT1OXJwhCUmR2dKVy7psa8xzElSyzqx7oJyfJ1
JZyOzToj9T5SfTIq396agbHJWVfYphNahvZ/7uMXqHxf+ZH9BL1gk9Y6kCnbM5R6
0gfwjyW1/dQPjOzn9N394zd2FJoFHwdq9Qs0wBugspULZVNRxq7veq/fzwIDAQAB
AoGBAJ8dRTQFhIllbHx4GLbpTQsWXJ6w4hZvskJKCLM/o8R4n+0W45pQ1xEiYKdA
Z/DRcnjltylRImBD8XuLL8iYOQSZXNMb1h3g5/UGbUXLmCgQLOUUlnYt34QOQm+0
KvUqfMSFBbKMsYBAoQmNdTHBaz3dZa8ON9hh/f5TT8u0OWNRAkEA5opzsIXv+52J
duc1VGyX3SwlxiE2dStW8wZqGiuLH142n6MKnkLU4ctNLiclw6BZePXFZYIK+AkE
xQ+k16je5QJBAN0TIKMPWIbbHVr5rkdUqOyezlFFWYOwnMmw/BKa1d3zp54VP/P8
+5aQ2d4sMoKEOfdWH7UqMe3FszfYFvSu5KMCQFMYeFaaEEP7Jn8rGzfQ5HQd44ek
lQJqmq6CE2BXbY/i34FuvPcKU70HEEygY6Y9d8J3o6zQ0K9SYNu+pcXt4lkCQA3h
jJQQe5uEGJTExqed7jllQ0khFJzLMx0K6tj0NeeIzAaGCQz13oo2sCdeGRHO4aDh
HH6Qlq/6UOV5wP8+GAcCQFgRCcB+hrje8hfEEefHcFpyKH+5g1Eu1k0mLrxK2zd+
4SlotYRHgPCEubokb2S1zfZDWIXW3HmggnGgM949TlY=
-----END RSA PRIVATE KEY-----
verification_key: |
-----BEGIN PUBLIC KEY-----
MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDHFr+KICms+tuT1OXJwhCUmR2d
KVy7psa8xzElSyzqx7oJyfJ1JZyOzToj9T5SfTIq396agbHJWVfYphNahvZ/7uMX
qHxf+ZH9BL1gk9Y6kCnbM5R60gfwjyW1/dQPjOzn9N394zd2FJoFHwdq9Qs0wBug
spULZVNRxq7veq/fzwIDAQAB
-----END PUBLIC KEY-----
no_ssl: true
url: http://uaa.53.62.110.98.xip.io
# code_snippet cf-minimal-aws end
# The previous line helps maintain current documentation at
http://docs.cloudfoundry.org.

Thanks a lot for looking into this.

Regards,
Kinjal

On Tue, Dec 8, 2015 at 6:28 AM, Gwenn Etourneau <getourneau(a)pivotal.io>
wrote:

Hi,

Please give your manifest and so on...
No magic here we need to check this kind of things.

Btw no need to put Urgent here, it's a community based support, if you
need commercial support you can ask to Pivotal, IBM and so on..

Thanks

On Tue, Dec 8, 2015 at 2:17 AM, Kinjal Doshi <kindoshi(a)gmail.com> wrote:

Hi,

I am trying to deploy cloud foundry with the
stemcell light-bosh-stemcell-3147-aws-xen-hvm-ubuntu-trusty-go_agent.tgz
and cloud foundry release manifest cf-226yml

I am also using the minimal-aws.yml for configuration data.

During 'bosh deploy' command, I run into the following deployment error:

Started preparing deployment
Started preparing deployment > Binding releases. Done (00:00:00)
Started preparing deployment > Binding existing deployment. Done
(00:00:01)
Started preparing deployment > Binding resource pools. Done (00:00:00)
Started preparing deployment > Binding stemcells. Done (00:00:00)
Started preparing deployment > Binding templates. Done (00:00:00)
Started preparing deployment > Binding properties. Done (00:00:00)
Started preparing deployment > Binding unallocated VMs. Done (00:00:00)
Started preparing deployment > Binding instance networks. Done
(00:00:00)

Started preparing package compilation > Finding packages to compile.
Done (00:00:00)

Started preparing dns > Binding DNS. Done (00:00:00)

Started preparing configuration > Binding configuration. Failed: Error
filling in template `dea.yml.erb' for `runner_z1/0' (line 86: bad
component(expected user component): Oro(a)1602) (00:00:01)

Error 100: Error filling in template `dea.yml.erb' for `runner_z1/0'
(line 86: bad component(expected user component): Oro(a)1602)

I noticed that the property cc.internal_api_user is missing from the
global properties and have added the same to minimal-aws.yml but the
deployment still fails.

I need to have the CF deployment up and running tonight. Would be great
if some one can please help me with this on priority?

Regards,
Kinjal

Join {cf-dev@lists.cloudfoundry.org to automatically receive all group messages.