Testing and Audit of Software projects
The quality of the product is directly related to the quality of the development process. We have undertaken manual testing and audit of software based systems. Some of the common problems in the projects and failures encountered in the product are listed below.
Problems observed in Projects
User requirements (RFP/ Contract) Missing/ Inadequately defined
Key Requirements (RFP/ Contract) Not implemented/ Partially implemented, deviations in requirements and requirements deferred
Architectural Deviations - Interoperability, Security & Performance related problems
Frequent failures/ system crash Fatal errors, data loss & data corruption
Serious problems & functional gaps No proper fixing, temporary workaround
Performance & Scalability Slow response & over utilization of computing resources
Robustness, Stability & Availability Frequent failures & crashes, abnormally long down time & slow recovery
Integration & Interoperability- Incomplete workflow, No data exchange among components & systems
Security of Software & Data Wrongly configured systems, Inadequate authentication, access control and audit logs
Usability Cumbersome & lengthy navigations, poor messaging
Change Control
Informal/ unauthorized modifications carried out directly on production system
Digitization & Data Migration Errors Wrong/ unreliable data in the system
Code & Data Synchronization between DC & DR DC/ DR switchover failure
Documentation Issues
- Missing/ Incomplete/ Incorrect documentation;
- Inconsistency-Among documentation/With application;
- Unclear/ ambiguous documentation;
- Ineffective document control (change & version control)
Functionality Issues
- Run time fatal error, Data loss/ corruption;
- Wrong/ incomplete workflows;
- Business logic & Data validation errors;
- Transactions not traceable/ work items missing, Transactions wrongly rejected;
- Wrong calculations & incorrect rules;
- Interface problems (payment gateway, bank interface, etc.);
- Integration of various modules/ functions of the software not done;
- Interoperability problems among software modules
Web Site/Portal Issues
- Inconsistent Home/ Web pages;
- Missing/ Broken links - Site links not working;
- Accessibility requirements as per W3C hardly met;
- Incorrect/ Obsolete contents;
- Important buttons/ keys disabled;
- Site map not available;
- Search function not available/ not working
Performance Issues
- Extremely slow Home/ Web page loading, document downloading & uploading;
- Inability of system to sustain increase in transactions/ data volume;
- System crash at much lower users load as against specified requirements;
- Over utilization of system resources such as CPU, Memory, BW, etc.
Security Issues
- Weak Application Security; (SQL Injection, Privilege escalation, Data loss, Access Control, Error handling/ Information leakage, Session Management, Denial of Services, Audit logs, etc.)
- Missing/ ineffective security policy (E.g., Password policy);
- Mis-configured/ vulnerable systems such as servers, firewalls, etc;
- Improper authentication & access control (access rights & authorizations);
- Inadequate confidentiality/ integrity (credentials transmitted in clear text) ;
- Risk assessment & BCP not done/ not tested;
- Inappropriate data backup & archival for disaster recovery;
- Inadequate physical security;
Usability Issues
- Cumbersome/ lengthy navigation;
- Poor/ missing user instructions/ Help functions;
- Improper/ misleading messages for users;
- Accessibility requirements not addressed properly
|