Page MenuHomePhabricator

Cloud-VPS (Project-requests)Milestone
ActivePublic

Details

Description

Requests for creating or deleting Cloud-VPS projects. See openstack-browser for a list of existing projects and their members. For quota changes see Cloud-VPS (Quota-requests)

Before you request a project

  1. Confirm you cannot run your code/bot/thing on Toolforge. You can request access to Toolforge by following the instructions on wikitech. With Toolforge, the underlying infrastructure will be taken care of for you, and you can focus on writing your tool / bot / researchy-thing.
  1. Only request a VPS project if you need root on the VM for a specific purpose (or need testing VMs for MediaWiki changes, etc). Remember that if you have root you have responsibilities too! :)

Maintainer responsibilities

Each Cloud VPS project must have one or more active maintainers. Maintainers must have an active Phabricator account, must subscribe to the cloud-announce mailing list, and must respond to tasks, emails, and requests for action on the part of WMCS staff and admins.

In addition, maintainers of VMs in Cloud VPS projects must provide basic maintenance on their servers: puppet needs to be kept in working order, upgrades will need to be applied periodically, and VMs will need to be periodically deleted and recreated with updated OS images.

If a project is not actively maintained, or WMCS staff are unable to contact maintainers for a long period of time, that project will be shut down and ultimately deleted along with all associated configuration and data.

Project scope

Cloud VPS projects should be scoped based around concrete products or software projects, rather than the team working on them. The three main problems that we (the Cloud Services team) have seen in the past with team ownership/scope for Cloud VPS projects are:

  • Team gets disbanded/reorganized but its project needs to live on due to hosting of important VMs
  • Difficulty establishing who is the primary point of contact for a given VM when trying to reclaim quota or fix a broken instance
  • Tendency to close membership/participation to only team members rather than inviting participation by other volunteers

There are things that can be done to mitigate these problems, but the easiest thing to do is to create more targeted projects that are scoped to a product/project rather than a team. This can become a burden in other ways if a common group of developers is active on a large number of such projects, so we are willing to be flexible if good cause can be shown for project consolidation.

For more guidance, see https://wikitech.wikimedia.org/wiki/Help:Cloud_VPS_project

Requesting a new project

To request a new project, create a task using this link, and fill out the requested information by <replacing the instructions>

Note that there's currently some restrictions on the name of the project: it should not contain underscores or special characters, because it will be used in DNS records.

Process

Requests are processed by the Cloud Services team during the Cloud Services team meeting every Wednesday (8:00 PST) that the meeting is held. This schedule may be effected by holidays, conferences, or other unavailability. Requests can be granted when approved by a quorum of at least two WMCS team members.

Once approved (typically noted with a "+1" or "approved" comment on the task), creation of the project in OpenStack will be handled by a member of the Cloud VPS admin team. This will typically happen within 1-2 days, but may take longer due to availability of computing resources or higher priority administration tasks.

See also

Recent Activity

Wed, Nov 20

Mhurd added a project to T380335: Request creation of "mediawiki-quickstart" VPS project: MediaWiki-Quickstart.
Wed, Nov 20, 6:08 PM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
aborrero closed T380335: Request creation of "mediawiki-quickstart" VPS project as Resolved.
Wed, Nov 20, 10:35 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
zeljkofilipin moved T380335: Request creation of "mediawiki-quickstart" VPS project from Backlog 🪒 to Watching 📺 on the User-zeljkofilipin board.
Wed, Nov 20, 10:34 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
zeljkofilipin added a project to T380335: Request creation of "mediawiki-quickstart" VPS project: User-zeljkofilipin.
Wed, Nov 20, 10:33 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Maintenance_bot removed a project from T380335: Request creation of "mediawiki-quickstart" VPS project: Patch-For-Review.
Wed, Nov 20, 10:30 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
CodeReviewBot added a comment to T380335: Request creation of "mediawiki-quickstart" VPS project.

aborrero merged https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/133

Wed, Nov 20, 10:26 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
CodeReviewBot added a project to T380335: Request creation of "mediawiki-quickstart" VPS project: Patch-For-Review.

aborrero opened https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/133

Wed, Nov 20, 10:02 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Peter added a parent task for T380335: Request creation of "mediawiki-quickstart" VPS project: T379222: Setup CI for quickstart.
Wed, Nov 20, 9:00 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
dcaro added a comment to T380335: Request creation of "mediawiki-quickstart" VPS project.

+1 approved

Wed, Nov 20, 8:21 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Mhurd updated the task description for T380335: Request creation of "mediawiki-quickstart" VPS project.
Wed, Nov 20, 2:38 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Mhurd updated the task description for T380335: Request creation of "mediawiki-quickstart" VPS project.
Wed, Nov 20, 12:14 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Mhurd updated the task description for T380335: Request creation of "mediawiki-quickstart" VPS project.
Wed, Nov 20, 12:13 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Mhurd updated the task description for T380335: Request creation of "mediawiki-quickstart" VPS project.
Wed, Nov 20, 12:12 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Mhurd updated the task description for T380335: Request creation of "mediawiki-quickstart" VPS project.
Wed, Nov 20, 12:11 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Mhurd updated the task description for T380335: Request creation of "mediawiki-quickstart" VPS project.
Wed, Nov 20, 12:04 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)
Mhurd created T380335: Request creation of "mediawiki-quickstart" VPS project.
Wed, Nov 20, 12:01 AM · MediaWiki-Quickstart, User-zeljkofilipin, Cloud-VPS (Project-requests)

Fri, Nov 15

Physikerwelt added a comment to T377655: Request creation of wikiqlever VPS project.

What is the next step here? I do not know what it means that this ticket has been worked on.

Fri, Nov 15, 9:31 AM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
Seppl2013 added a comment to T377655: Request creation of wikiqlever VPS project.

What is the next step here? I do not know what it means that this ticket has been worked on.

Fri, Nov 15, 9:10 AM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)

Sun, Nov 10

Reedy added a comment to T378042: Request creation of WikiPeopleStats VPS project.

See T379478: Members of project-a4b03ac235d443159feaeafec24a92dd not seemingly added to project-bastion for an issue with people added to this new project

Sun, Nov 10, 1:57 AM · Cloud-VPS (Project-requests)

Fri, Nov 8

fnegri closed T378975: Request creation of wmde-techwishes-survey VPS project as Resolved.

The project was created and users awight and wmde-fisch were added as "members".

Fri, Nov 8, 5:45 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)

Thu, Nov 7

fnegri edited Description on Cloud-VPS (Project-requests).
Thu, Nov 7, 1:35 PM
Maintenance_bot removed a project from T378975: Request creation of wmde-techwishes-survey VPS project: Patch-For-Review.
Thu, Nov 7, 1:30 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
CodeReviewBot added a comment to T378975: Request creation of wmde-techwishes-survey VPS project.

aborrero merged https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/119

Thu, Nov 7, 1:23 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
dcaro added a comment to T378975: Request creation of wmde-techwishes-survey VPS project.

+1

Thu, Nov 7, 1:15 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
CodeReviewBot added a project to T378975: Request creation of wmde-techwishes-survey VPS project: Patch-For-Review.

aborrero opened https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/119

Thu, Nov 7, 1:06 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
aborrero moved T378975: Request creation of wmde-techwishes-survey VPS project from Inbox to Approved on the Cloud-VPS (Project-requests) board.

looks good to me, +1

Thu, Nov 7, 12:48 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
awight added a comment to T378975: Request creation of wmde-techwishes-survey VPS project.

We won't need object storage, so perhaps the dashes in the project name are acceptable? Otherwise, "wmdetechwishessurvey" aargh is fine.

Thu, Nov 7, 12:43 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)

Mon, Nov 4

joanna_borun added a comment to T296556: Request creation of capacity-exchange VPS project.

@Andrew maybe worth checking with https://meta.wikimedia.org/wiki/User:AJurno_(WMB) , https://meta.wikimedia.org/wiki/User:AInacio_(WMB)

Mon, Nov 4, 5:06 PM · Cloud-VPS (Project-requests)
Maintenance_bot removed a project from T377655: Request creation of wikiqlever VPS project: Patch-For-Review.
Mon, Nov 4, 4:31 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
awight updated the task description for T378975: Request creation of wmde-techwishes-survey VPS project.
Mon, Nov 4, 4:08 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
aborrero closed T377655: Request creation of wikiqlever VPS project as Resolved.

done, please create a separate ticket for quota requests.

Mon, Nov 4, 4:00 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
CodeReviewBot added a comment to T377655: Request creation of wikiqlever VPS project.

aborrero merged https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/115

Mon, Nov 4, 3:56 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
CodeReviewBot added a project to T377655: Request creation of wikiqlever VPS project: Patch-For-Review.

aborrero opened https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/115

Mon, Nov 4, 3:51 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
Physikerwelt added a comment to T377655: Request creation of wikiqlever VPS project.

Maybe we can create the project with the default quotas, and you can ask for whatever quota bump later once the data is clear to you?

Mon, Nov 4, 3:46 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
aborrero added a comment to T377655: Request creation of wikiqlever VPS project.

Maybe we can create the project with the default quotas, and you can ask for whatever quota bump later once the data is clear to you?

Mon, Nov 4, 3:44 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
awight added a parent task for T378975: Request creation of wmde-techwishes-survey VPS project: T378946: Set up a development platform for 2024 Tech Wishes survey.
Mon, Nov 4, 2:56 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
awight moved T378975: Request creation of wmde-techwishes-survey VPS project from Sprint Backlog to Watching / Epic / Stalled on the WMDE-TechWish-Sprint-2024-10-16 board.
Mon, Nov 4, 2:56 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
awight created T378975: Request creation of wmde-techwishes-survey VPS project.
Mon, Nov 4, 2:13 PM · Unplanned-Sprint-Work, WMDE-TechWish-Sprint-2024-10-16, WMDE-TechWish-Survey, Cloud-VPS (Project-requests)
Maintenance_bot removed a project from T378042: Request creation of WikiPeopleStats VPS project: Patch-For-Review.
Mon, Nov 4, 10:31 AM · Cloud-VPS (Project-requests)
aborrero closed T378042: Request creation of WikiPeopleStats VPS project as Resolved.
Mon, Nov 4, 10:09 AM · Cloud-VPS (Project-requests)
CodeReviewBot added a project to T378042: Request creation of WikiPeopleStats VPS project: Patch-For-Review.

aborrero opened https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/114

Mon, Nov 4, 10:05 AM · Cloud-VPS (Project-requests)
CodeReviewBot added a comment to T378042: Request creation of WikiPeopleStats VPS project.

aborrero merged https://gitlab.wikimedia.org/repos/cloud/cloud-vps/tofu-infra/-/merge_requests/114

Mon, Nov 4, 10:05 AM · Cloud-VPS (Project-requests)

Thu, Oct 31

Seppl2013 added a comment to T377655: Request creation of wikiqlever VPS project.

@bking - thanks for the hint i'll try it out on the upcoming imports

Thu, Oct 31, 10:44 AM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)

Wed, Oct 30

bking added a comment to T377655: Request creation of wikiqlever VPS project.

@Seppl2013 I recommend sysstat (also known as sar) for tracking memory and load. sysstat takes 10 minute samples by default, and you can see the memory stats with sar -r. Let us know if you have any other questions.

Wed, Oct 30, 8:39 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)

Mon, Oct 28

Gehel moved T377655: Request creation of wikiqlever VPS project from Incoming to Watching / Waiting on the Wikidata-Query-Service board.
Mon, Oct 28, 4:30 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)

Oct 24 2024

Seppl2013 added a comment to T377655: Request creation of wikiqlever VPS project.

Do you know a tool that will track CPU and Mem load of a server over time (on an Ubuntu server)?
Currently we have 3% Memory of 512 GB and 300% CPU Load (of 16 cores) while the indexing runs. Hannah Bast reported the memory needs are not at 128 GB any more these days but the peak i do not know. If we want to go try and error we could go with the current max and run things for a test.

Oct 24 2024, 3:36 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
bking added a comment to T377655: Request creation of wikiqlever VPS project.

@aborrero sorry for the confusion. I believe we are talking about a single server, as opposed to a project-wide quota.

yeah, the only quotas that exists in Cloud VPS are project-wide.

So, you all can do the math of how many RAM, CPU, disk, instances. you need in total for the project, even if only a single VM will be used, and that would be the project quota that we would need to evaluate/approve/set.

Oct 24 2024, 1:23 PM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)
aborrero assigned T378042: Request creation of WikiPeopleStats VPS project to Raymond_Ndibe.

LGTM. +1

Oct 24 2024, 8:07 AM · Cloud-VPS (Project-requests)
aborrero triaged T378042: Request creation of WikiPeopleStats VPS project as Medium priority.
Oct 24 2024, 8:05 AM · Cloud-VPS (Project-requests)
Seppl2013 added a comment to T377655: Request creation of wikiqlever VPS project.

@Harej
thank you for pointing out your infrastructure availabilty which is sort of already "priced" in in the calculation. We are seeking a third mirror environment sponsored by the Mediawiki foundation. As for the technical aspects: https://wiki.bitplan.com/index.php/Wikidata_Import_2024-10-17

Oct 24 2024, 5:07 AM · Wikidata, Data-Platform-SRE, Wikidata-Query-Service, Cloud-VPS (Project-requests)