pangea
/
django-orchestra
7
0
Fork 0
Code Issues 1 Pull Requests 2 Packages Projects Releases Wiki Activity
django-orchestra/TODO.md

12 KiB
Raw Blame History

==== TODO ====

  • use format_html_join for orchestration email alerts

  • enforce an emergency email contact and account to contact contacts about problems when mailserver is down

  • add BackendLog retry action

  • webmail identities and addresses

  • Permissions .filter_queryset()

  • env vars instead of multiple settings files: https://devcenter.heroku.com/articles/config-vars ?

  • backend logs with hal logo

  • LAST version of this shit http://wkhtmltopdf.org/downloads.h otml

  • help_text on readonly_fields specialy Bill.state. (eg. A bill is in OPEN state when bla bla )

  • create log file at /var/log/orchestra.log and rotate

  • order.register_at @property def register_on(self): return order.register_at.date()

  • mail backend related_models = ('resources__content_type') ??

  • Maildir billing tests/ webdisk billing tests (avg metric)

  • when using modeladmin to store shit like self.account, make sure to have a cleanslate in each request? no, better reuse the last one

  • jabber with mailbox accounts (dovecot mail notification)

  • rename accounts register to "account", and reated api and admin references

  • AccountAdminMixin auto adds 'account__name' on searchfields

  • What fields we really need on contacts? name email phone and what more?

  • Redirect junk emails and delete every 30 days?

  • DOC: Complitely decouples scripts execution, billing, service definition

  • init.d celery scripts -# Required-Start: $network $local_fs $remote_fs postgresql celeryd -# Required-Stop: $network $local_fs $remote_fs postgresql celeryd

  • regenerate virtual_domains every time (configure a separate file for orchestra on postfix)

  • Backend optimization

    • fields = ()
    • ignore_fields = ()
    • based on a merge set of save(update_fields)

  • proforma without billing contact?

  • print open invoices as proforma?

  • env ORCHESTRA_MASTER_SERVER='test1.orchestra.lan' ORCHESTRA_SECOND_SERVER='test2.orchestra.lan' ORCHESTRA_SLAVE_SERVER='test3.orchestra.lan' python manage.py test orchestra.apps.domains.tests.functional_tests.tests:AdminBind9BackendDomainTest --nologcapture

  • ForeignKey.swappable

  • Field.editable

  • ManyToManyField.symmetrical = False (user group)

  • REST PERMISSIONS

  • caching based on "def text2int(textnum, numwords={}):"

  • sync() ServiceController method that synchronizes orchestra and servers (delete or import)

  • consider removing mailbox support on forward (user@pangea.org instead)

  • Databases.User add reverse M2M databases widget (like mailbox.addresses)

  • Grant permissions to systemusers

  • Make one dedicated CGI user for each account only for CGI execution (fpm/fcgid). Different from the files owner, and without W permissions, so attackers can not inject backdors and malware.

  • resource min max allocation with validation

  • domain validation parse named-checzone output to assign errors to fields

  • Directory Protection on webapp and use webapp path as base path (validate)

  • validate systemuser.home on server-side

  • webapp backend option compatibility check? raise exception, missconfigured error

  • admin systemuser home/directory, add default home and empty directory with has_shell on admin

  • Resource used_list_display=True, allocated_list_displat=True, allow resources to show up on list_display

  • BackendLog.updated_at (tasks that run over several minutes when finished they do not appear first on the changelist) (like celery tasks.when)

  • Periodic task for cleaning old monitoring data

  • Create an admin service_view with icons (like SaaS app)

  • Resource graph for each related object

  • SaaS model splitted into SaaSUser and SaaSSite? inherit from SaaS, proxy model?

  • prevent @pangea.org email addresses on contacts, enforce at least one email without @pangea.org

  • forms autocomplete="off", doesn't work in chrome

ln -s /proc/self/fd /dev/fd

POST INSTALL

  • Generate a password-less ssh key, and copy it to the servers you want to orchestrate. ssh-keygen ssh-copy-id root@

Php binaries should have this format: /usr/bin/php5.2-cgi

  • logs on panel/logs/ ? mkdir ~webapps, backend post save signal?

  • and other IfModule on backend SecRule

  • Orchestra global search box on the page head, based https://github.com/django/django/blob/master/django/contrib/admin/options.py#L866 and iterating over all registered services and inspectin its admin.search_fields

  • contain error on plugin missing key (plugin dissabled): NOP, fail hard is better than silently, perhaps fail at starttime? apploading machinary

  • contact.alternative_phone on a phone.tooltip, email:to

  • better validate options and directives (url locations, filesystem paths, etc..)

  • make sure that you understand the risks

  • full support for deactivation of services/accounts

    • Display admin.is_active (disabled account special icon and order by support)

  • lock resource monitoring

  • -EXecCGI in common CMS upload locations /wp-upload/upload/uploads

  • cgi user / pervent shell access

  • prevent stderr when users exists on backend i.e. mysql user create

  • disable anonymized list options (mailman)

  • tags = GenericRelation(TaggedItem, related_query_name='bookmarks')

  • user provided crons

$moodle_host = $SERVER[‘HTTP_HOST’]; require_once(‘/etc/moodles/’.$moodle_host.‘config.php’);``` moodle/drupla/php-list multi-tenancy

  • make account available on all admin forms

WPMU blog traffic

  • more robust backend error handling, continue executing but exit code > 0 if failure: failing_cmd || exit_code=1 and don't forget to call super.commit()!!

  • website directives uniquenes validation on serializers

  • is_Active custom filter with support for instance.account.is_Active annotate with F() needed (django 1.8)

delete apache logs and php logs

  • document service help things: discount/refound/compensation effect and metric table
  • Document metric interpretation help_text
  • document plugin serialization, data_serializer?

bill line managemente, remove, undo (only when possible), move, copy, paste

* budgets: no undo feature

  • Autocomplete admin fields like <site_name>.phplist... with js

  • autoexpand mailbox.filter according to filtering options (js)

  • allow empty metric pack for default rates? changes on rating algo

don't produce lines with cost == 0 or quantity 0 ? maybe minimal quantity for billing? like 0.1 ? or minimal price? per line or per bill?

DOMINI REGISTRE MIGRATION SCRIPTS

IMPORTANT delete domain xina: missing FROM-clause entry for table "t3" LINE 1: SELECT (CONCAT(T3.name, domains_domain.name)) AS "structured...

lines too long on invoice, double lines or cut, and make margin wider

display subline links on billlines, to show that they exists.

  • update service orders on a celery task? because it take alot

billline quantity eval('10x100') instead of miningless description '(10*100)' line.verbose_quantity

FIXME do more test, make sure billed until doesn't get uodated whhen services are billed with les metric, and don't upgrade billed_until when undoing under this circumstances

* line 513: change threshold and one time service metric change should update last value if not billed, only record for recurring invoicing. postpay services should store the last metric for pricing period.
* add ini, end dates on bill lines and breakup quanity into size(defaut:1) and metric
* threshold for significative metric accountancy on services.handler
* http://orchestra.pangea.org/admin/orders/order/6418/
* http://orchestra.pangea.org/admin/orders/order/6495/bill_selected_orders/

  • move normurlpath to orchestra.utils from websites.utils

  • write down insights

use english on services defs and so on, an translate them on render time

python3 manage.py dumpdata services.Service --indent 4 --natural

  • websites directives get_location() and use it on last change view validation stage to compare with contents.location and also on the backend ?

  • modeladmin Default filter + search isn't working, prepend filter when searching

  • create service help templates based on urlqwargs with the most basic services.

TDOO Base price: domini propi (all domains) + extra for other domains

IMPORTANT op.instance = copy.deepcopy(instance) ValueError: Cannot assign "<SaaS: blog@WordPressService>": "SaaS" instance isn't saved in the database.

Separate operation from models !! BackendOperation and Operation

Translation

mkdir locale django-admin.py makemessages -l ca django-admin.py compilemessages -l ca

https://docs.djangoproject.com/en/1.7/topics/i18n/translation/#joining-strings-string-concat

from django.utils.translation import ugettext from django.utils import translation translation.activate('ca') ugettext("Description")

  • saas validate_creation generic approach, for all backends. standard output

  • html code x: × for bill line verbose quantity

  • periodic task to cleanup backendlogs, monitor data and metricstorage

  • create orchestrate databases.Database pk=1 -n --dry-run | --noinput --action save (default)|delete --backend name (limit to this backend) --help

  • uwsgi --max-requests=5000 \ # respawn processes after serving 5000 requests and celery max-tasks-per-child

  • generate settings.py more like django (installed_apps, middlewares, etc,,,)

  • postupgradeorchestra send signals in order to hook custom stuff

  • autoscale celery workers http://docs.celeryproject.org/en/latest/userguide/workers.html#autoscaling

  • webapp has_website list filter

glic3rinu's django-fluent-dashboard

  • gevent is not ported to python3 :'(

FIXME account deletion generates an integrity error

https://code.djangoproject.com/ticket/24576

FIXME what to do when deleting accounts? set fk null and fill a username charfield? issues, invoices.. we whant all this to go away?

  • implement delete All related services

FIXME address name change does not remove old one :P, readonly, perhaps we can regenerate all addresses using backend.prepare()?

  • read https://docs.djangoproject.com/en/dev/releases/1.8/ and fix deprecation warnings

  • remove admin object display_links , like contents webapps

  • SaaS and WebApp types and services fieldsets, and helptexts !

  • replace make_option in management commands

  • welcome, pangea linke doesnt work

FIXME model contact info and account info (email, name, etc) correctly/unredundant/dry

  • Use the new django.contrib.admin.RelatedOnlyFieldListFilter in ModelAdmin.list_filter to limit the list_filter choices to foreign objects which are attached to those from the ModelAdmin.
  • Query Expressions, Conditional Expressions, and Database Functions¶

  • forms: You can now pass a callable that returns an iterable of choices when instantiating a ChoiceField.

  • migrate to DRF3.x

  • move all tests to django-orchestra/tests

  • *natural keys: those fields that uniquely identify a service, list.name, website.name, webapp.name+account, make sure rest api can not edit thos things

migrations accounts, bill, orders, auth -> migrate the rest (contacts lambda error)

  • MultiCHoiceField proper serialization

Apache restart fails: detect if appache running, and execute start

Change crons, create cron for deleted webapps and users

  • UNIFY PHP FPM settings name

virtualhost name name-account?

  • add a delay to changes on the webserver apache to no overwelm it with backend executions?

  • replace unique_name by natural_key?

  • do not require contact or create default

  • send signals for backend triggers

  • monitor resources with multiple backends not possible to identify the correct last execution, allow to specify backends only once or change backend.model = 'resources.MonitorData'

  • force ignore slack billing period overridig when billing

  • fpm reload starts new pools?

  • more processes for webmail, or use fpm pool

  • rename resource.monitors to resource.backends ?

  • abstract model classes enabling overriding?